-- Logs begin at Fri 2022-08-05 13:30:40 UTC, end at Fri 2022-08-05 14:53:12 UTC. -- Aug 05 14:16:39.970165 dv-cinder-802955-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 14:16:39.978923 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 14:16:39 2022] *** Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: nodename: dv-cinder-802955-8-iscsi Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: machine: x86_64 Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: clock source: unix Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: pcre jit disabled Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: detected number of CPU cores: 4 Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: current working directory: / Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: detected binary path: /usr/bin/uwsgi-core Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: your processes number limit is 47680 Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: your memory page size is 4096 bytes Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: detected max file descriptor number: 2048 Aug 05 14:16:39.980959 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: lock engine: pthread robust mutexes Aug 05 14:16:39.987410 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: thunder lock: enabled Aug 05 14:16:39.987410 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 14:16:39.987410 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 14:16:40.021500 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: Python main interpreter initialized at 0x555d0161b9c0 Aug 05 14:16:40.021500 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: python threads support enabled Aug 05 14:16:40.021500 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: your server socket listen backlog is limited to 100 connections Aug 05 14:16:40.021500 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: your mercy for graceful operations on workers is 90 seconds Aug 05 14:16:40.021834 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 14:16:40.021910 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: *** Operational MODE: preforking *** Aug 05 14:16:40.022160 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: *** uWSGI is running in multiple interpreter mode *** Aug 05 14:16:40.022160 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: spawned uWSGI master process (pid: 103535) Aug 05 14:16:40.022351 dv-cinder-802955-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 14:16:40.023694 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: spawned uWSGI worker 1 (pid: 103536, cores: 1) Aug 05 14:16:40.023694 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: spawned uWSGI worker 2 (pid: 103537, cores: 1) Aug 05 14:16:40.023694 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 14:16:40.681542 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 14:16:40.682141 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 14:16:41.765564 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:16:41.765564 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: from cryptography.utils import int_from_bytes Aug 05 14:16:41.766370 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:16:41.766370 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: from cryptography.utils import int_from_bytes Aug 05 14:16:41.767067 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:16:41.767067 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: from cryptography.utils import int_from_bytes Aug 05 14:16:41.767497 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:16:41.767497 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: from cryptography.utils import int_from_bytes Aug 05 14:16:44.232826 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 14:16:44.233421 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 14:16:44.233527 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 14:16:44.233877 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 14:16:44.233973 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 14:16:44.234063 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 14:16:44.234162 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 14:16:44.234253 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 14:16:44.235033 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 14:16:44.235196 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.235292 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 14:16:44.235402 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.235658 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.235764 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.236233 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.236331 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.236572 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.236693 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.236891 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.236990 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.237199 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.237296 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.237503 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.237598 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.237817 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.237918 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238067 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238164 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238373 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238483 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238684 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238782 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-8-iscsi {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.238989 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239091 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239284 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239382 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-8-iscsi {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239583 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239670 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239887 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.239983 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.240181 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.240268 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.240512 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.240603 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.240808 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.240907 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.241120 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.241291 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.241422 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.242424 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.242572 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.242700 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.242827 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.242953 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243077 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243199 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243325 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243449 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243572 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243707 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243849 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.243988 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244121 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244254 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244380 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244537 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244653 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244787 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.244903 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245026 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-8-iscsi {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245150 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245283 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245408 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-8-iscsi {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245532 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245656 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245789 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.245914 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246038 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246169 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246308 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246536 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246675 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246842 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.246989 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.247128 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.247255 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.247444 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.247574 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.247759 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.247904 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.248061 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.248198 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.248366 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.248541 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.248755 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.248903 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249043 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249169 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249294 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249425 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249558 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249693 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249860 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.249991 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.250207 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.250338 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.250506 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.250700 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.250841 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251007 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251137 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251315 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251444 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251581 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251754 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.251880 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252004 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252158 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252287 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252459 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252591 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252716 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.252858 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253033 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253186 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253323 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253455 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253588 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253722 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253865 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.253993 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.254166 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.254303 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.254467 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.254594 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.254761 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.254892 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255058 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255189 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255357 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255485 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255659 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255788 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.255958 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.256087 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.256259 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.256396 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.256587 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.256724 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.256874 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257004 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257198 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257335 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257492 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257621 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257790 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.257923 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.258115 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.258257 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.258408 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.258542 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.258707 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.258848 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259049 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259192 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259330 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259459 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259590 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259716 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.259871 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260017 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260165 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260302 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260495 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260646 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260813 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.260950 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261104 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261231 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261355 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261482 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261615 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261741 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.261905 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.262041 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.262214 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.262350 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.262579 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.262749 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.262878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263010 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263135 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263267 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263401 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263528 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263652 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263784 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.263910 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264035 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264196 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264534 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264665 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264799 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.264935 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.265072 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.265205 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.265362 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.265499 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.265710 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.265848 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266020 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266312 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266585 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266720 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266857 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.266983 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267097 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267219 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267356 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267482 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267653 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267794 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.267957 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.268086 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.268259 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.268393 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.268572 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.268708 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.268873 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269025 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269221 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269357 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269501 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269628 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269753 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.269878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270058 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270196 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270359 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270489 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270659 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270796 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.270950 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271086 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271248 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271385 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271545 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271671 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271840 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.271976 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.272136 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.272266 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.272445 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.272592 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.272746 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.272883 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273041 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273178 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273336 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273465 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273629 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273767 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.273924 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274052 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274212 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274350 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274515 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274652 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274810 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.274946 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275107 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275234 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275399 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275526 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275689 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275816 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.275995 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.276133 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.276297 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.276442 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.276623 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.276764 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.276923 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.277053 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.277237 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:16:44.277368 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.277565 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.277694 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.277891 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278033 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278199 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278326 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278504 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278810 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.278953 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279125 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279349 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279480 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279605 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279729 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279867 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.279994 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.280119 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.280301 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.280504 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.280647 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.280784 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.280945 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.281074 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.281764 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282090 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282241 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282378 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282507 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282632 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282757 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.282882 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283007 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283213 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283343 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283477 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283604 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283772 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.283915 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.284080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.284211 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.284394 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.284550 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.284745 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.284888 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285062 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285192 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285371 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285500 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285685 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285821 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.285987 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.286117 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.286289 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.286428 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.286600 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.286740 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.286919 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287050 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287224 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287354 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287527 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287664 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287834 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.287964 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.288138 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.288266 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.288460 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.288596 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.288766 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.288907 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289068 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289206 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289427 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289563 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289690 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289817 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.289976 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.290107 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.290276 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.290416 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.290582 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.290718 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.290881 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291010 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291184 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291316 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291487 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291616 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291783 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.291973 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292109 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292236 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292369 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292527 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292655 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292790 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.292956 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.293087 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.293265 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.293396 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.293760 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.293923 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294196 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294326 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294452 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294577 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294711 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294838 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.294971 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295106 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295232 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295366 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295501 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295643 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295804 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.295931 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296058 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296217 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296353 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296560 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296689 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296822 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.296976 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.297857 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.297989 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.298164 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.298295 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.298474 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.298608 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.298773 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.298901 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299071 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299202 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299378 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299529 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299728 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299858 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.299984 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.300114 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.300247 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.300387 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.300582 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.300713 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.300892 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301023 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301197 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301342 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301499 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301629 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301804 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.301931 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.302112 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.302251 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.302415 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.302544 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.302730 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.302858 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303040 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303171 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303347 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303483 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303646 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303777 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.303949 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304246 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304376 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304570 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304712 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304856 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.304983 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.305156 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.305286 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.305451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.305613 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.305757 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.305891 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306018 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306143 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306309 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306441 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306605 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.306919 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307049 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307219 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307357 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307646 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307812 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.307940 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.308105 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.308242 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.308461 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.308593 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.308762 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.308893 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.309065 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.309210 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.309367 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.309497 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.309668 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.309892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310032 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310158 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310283 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310408 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310587 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310717 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.310892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311023 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311196 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311324 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311499 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311636 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311848 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.311978 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.312103 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.312228 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.312387 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.312546 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.312750 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.312934 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313049 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313138 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313361 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313449 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313666 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313764 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.313979 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.314068 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.314278 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.314374 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.314585 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.314672 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.314915 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315003 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315239 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315335 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315549 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315637 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315854 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.315939 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.316154 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.316249 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.316493 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.316587 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.316796 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.316884 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.317098 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.317195 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.317401 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.317484 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.317707 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.317803 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318015 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318114 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318315 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318403 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318621 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318706 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.318920 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319007 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319223 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319308 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319523 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319610 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319832 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.319934 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.320130 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.320230 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.320451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.320542 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.320774 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.320870 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321167 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321379 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321473 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321683 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321769 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.321994 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322091 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322293 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322389 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322595 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322681 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322897 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.322984 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.323193 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.323294 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.323489 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.323577 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.323789 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.323884 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.324093 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.324190 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.324395 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.324504 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.324722 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.324807 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325016 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325113 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325317 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325404 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325615 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325718 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.325910 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326000 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326204 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326292 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326503 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326591 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326812 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.326903 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.327114 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.327200 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.327414 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.327503 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.327712 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.327801 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.328008 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.328108 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.328381 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.328520 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.328713 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.328875 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329032 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329184 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329348 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329482 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329649 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329782 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.329951 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.330083 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.330271 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.330417 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.330576 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.330722 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.330876 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331021 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331178 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331330 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331480 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331643 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331816 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.331946 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.332120 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.332254 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.332438 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.332582 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.332758 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.332894 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333058 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333189 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333369 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333499 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333682 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333813 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.333989 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.334119 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.334295 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.334425 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.334605 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.334733 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.334914 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335053 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335219 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335349 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335551 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335679 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335815 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.335944 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.336094 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.336225 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.336393 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.336564 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.336700 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.336827 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.337015 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.337145 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.337327 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.337571 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.337716 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.337902 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.338049 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.338252 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.338382 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.338522 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.338658 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.338801 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.339055 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.339185 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.339390 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.339530 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.339707 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.339847 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.340027 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.340158 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.340385 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.340650 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.340789 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.340918 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341044 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341171 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341296 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341431 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341567 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341694 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341833 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.341969 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342097 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342221 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342355 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342490 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342617 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342781 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.342911 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.343089 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.343232 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.343394 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.343525 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.343698 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.344323 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.344603 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.344749 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.344902 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345041 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345206 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345336 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345502 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345641 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345813 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.345941 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346110 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346247 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346405 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346550 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346685 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346812 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.346982 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.347112 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.347284 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.347413 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.347597 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.347725 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.347900 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348027 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348201 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348351 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348536 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348664 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348811 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.348942 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.349146 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.349276 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.349444 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.349572 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.349744 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.349871 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350038 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350178 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350333 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350463 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350674 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350825 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.350962 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351089 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351215 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351340 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351487 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351625 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351785 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.351912 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352072 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352201 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352371 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352541 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352678 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352805 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.352977 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.353107 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.353270 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.353410 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.353572 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.353702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.353872 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354002 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354168 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354308 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354462 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354591 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354763 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.354891 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355059 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355188 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355352 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355483 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355651 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355788 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.355934 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356067 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356229 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356360 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356546 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356674 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356842 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.356975 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.357135 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.357265 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.357434 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.357576 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.357712 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.357837 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358011 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358146 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358309 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358443 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358610 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.358902 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.359031 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.359195 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.359338 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.360062 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.360199 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.360364 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.360546 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.360674 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361146 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361282 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361409 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361541 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361667 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361801 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.361929 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362100 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362231 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362398 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362530 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362714 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362836 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.362960 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363085 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363256 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363386 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363553 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363683 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363845 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.363975 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.364138 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.364269 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.364499 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.364639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.364766 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.364891 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365024 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365159 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365300 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365427 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365598 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.365893 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366032 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366190 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366321 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366483 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366613 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366788 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.366930 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367092 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367220 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367394 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367529 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367695 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367833 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.367997 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.368127 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.368296 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.368453 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.368625 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.368761 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.368926 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369056 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369230 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369359 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369525 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369656 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369828 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.369964 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.370127 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.370257 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.370429 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.370561 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.370722 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.370867 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371059 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371196 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371337 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371465 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371591 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371732 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.371883 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372022 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372190 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372322 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372528 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372660 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372829 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.372972 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.373147 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.373277 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.373452 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.373582 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.373749 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.373890 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374048 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374177 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374348 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374478 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374646 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374785 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.374946 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.375152 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.375376 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.375525 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.375777 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.375920 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376048 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376181 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376308 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376459 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376602 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376737 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376865 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.376990 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377122 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377248 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377387 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377523 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377649 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377781 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.377936 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378073 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378234 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378363 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378534 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378656 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378831 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.378975 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.379131 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.379265 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.379423 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.379558 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.379741 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.379879 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380042 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380172 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380347 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380504 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380670 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380813 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.380976 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.381189 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.381317 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.381442 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.381588 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.381725 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.381892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382027 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382187 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382319 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382547 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382676 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382852 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.382981 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.383156 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.383285 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.383454 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.383583 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.383749 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.383878 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384043 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384173 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384343 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384525 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384684 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384814 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.384980 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.385109 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.385275 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.385415 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.385569 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.385700 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.385879 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386010 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386174 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386307 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386486 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386624 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386802 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.386940 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.387102 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.387232 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.387401 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.387539 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.387718 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.387866 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.388017 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.388147 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.388332 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.388493 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.388741 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.388882 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389052 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389183 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389349 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389486 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389645 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389773 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.389947 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.390077 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.390246 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.390383 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.390561 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.390745 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391004 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391167 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391364 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391496 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391623 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391757 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.391894 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392022 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392136 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392260 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392385 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392577 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392718 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392847 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.392981 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.393119 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.393377 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.393508 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.393687 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.393817 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.393986 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.394114 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.394298 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.394436 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.394604 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.394741 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.394899 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395027 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395194 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395334 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395494 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395625 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395790 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.395920 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.396086 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.396224 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.396399 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.396568 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.396718 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.396848 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397020 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397163 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397320 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397451 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397617 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397747 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.397914 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398046 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398214 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398352 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398526 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398656 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398818 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.398950 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.399130 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.399269 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.399437 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.399565 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.399737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.399877 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400037 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400168 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400331 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400501 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400666 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400796 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.400964 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.401092 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.401265 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.401491 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.401623 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.401749 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.401881 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402010 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402164 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402332 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402461 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402587 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402758 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.402881 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403059 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403195 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403362 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403492 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403663 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403802 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.403986 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.404130 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.404287 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.404448 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.404621 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.404750 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.404930 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405061 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405242 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405380 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405539 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405838 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.405965 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.406119 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.406769 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.406964 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.407097 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.407240 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.407369 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.407585 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.407715 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.407885 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408017 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408184 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408317 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408518 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408649 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408820 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.408951 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.409122 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.409253 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.409415 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.409544 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.409715 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.409919 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410049 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410186 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410313 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410439 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410565 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410699 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410857 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.410996 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.411167 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.411295 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.411529 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.411677 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.411806 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.411931 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412056 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412181 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412340 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412516 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412658 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412787 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.412981 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.413116 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.413279 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.413409 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.413584 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.413721 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.413892 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414020 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414197 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414327 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414505 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414636 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414806 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.414940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.415112 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.415243 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.415418 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.415548 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.415723 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.415862 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.416032 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.416230 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.416360 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.416586 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.416718 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.416919 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.417049 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.417192 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.417320 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.417476 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.417606 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.417776 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418043 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418174 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418364 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418492 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418667 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418807 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.418973 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.419102 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.419273 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.419403 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.419580 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.419709 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.419890 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420019 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420194 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420322 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420516 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420649 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420818 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.420949 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.421123 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.421268 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.421429 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.421573 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.421768 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.421918 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.422614 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.422839 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423032 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423164 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423291 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423417 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423550 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423692 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423833 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.423969 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.424104 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.424275 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.424469 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.424617 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.424783 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.424913 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.425090 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.425220 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.425400 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.425532 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.425708 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.425846 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426018 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426158 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426323 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426454 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426626 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426756 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.426935 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427073 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427244 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427375 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427549 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427679 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427853 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.427991 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.428158 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.428297 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.428557 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.428705 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.428923 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.429061 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.429254 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.429384 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.429568 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.429696 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.429877 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.430016 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.430188 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.430318 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.430495 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.430624 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.430802 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.431074 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.431203 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.431385 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.431515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.431680 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.431903 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432036 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432161 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432286 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432434 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432577 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432704 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.432882 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433040 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433160 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433266 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433446 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433585 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433755 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.433892 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.434056 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.434184 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.434413 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.434572 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.434701 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.434910 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.435038 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.435216 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.435354 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.435531 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.435699 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.435910 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.436115 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.436316 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.436559 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.436709 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.436839 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.436973 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437100 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437366 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437492 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437651 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437779 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.437991 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.438129 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.438306 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.438436 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.438611 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.438749 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.438921 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439059 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439223 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439351 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439517 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439645 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439817 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.439948 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.440112 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.440241 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.440425 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.440556 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.440731 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.440864 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441027 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441154 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441326 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441455 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441623 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441751 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.441963 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442099 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442234 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442362 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442496 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442624 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442776 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.442917 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443078 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443222 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443376 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443507 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443676 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443806 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.443972 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.444110 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.444270 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.444398 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.444595 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.444724 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.444893 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445036 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445188 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445316 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445495 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445622 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445790 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.445998 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446129 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446253 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446386 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446513 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446648 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446782 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.446953 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.447086 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.447251 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.447385 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.447568 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.447699 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.447868 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.448005 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.448212 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.448351 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.448538 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.448765 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.448904 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.449102 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.449241 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.449418 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.449557 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.449733 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.449861 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.450058 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.450186 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.450360 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.450492 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.450659 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.450887 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451025 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451220 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451359 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451539 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451669 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451831 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.451958 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.452165 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.452309 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.452477 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.452608 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.452735 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.452860 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.453011 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.453189 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.453364 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.453505 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.453670 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.453884 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454024 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454202 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454332 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454512 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454644 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454821 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.454960 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.455120 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.455248 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.455420 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.455560 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.455724 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.455865 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456032 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456162 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456337 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456514 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456653 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456781 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.456961 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457091 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457267 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457396 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457568 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457697 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457870 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.457998 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.458170 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.458297 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.458471 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.458604 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.458776 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.458907 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.459100 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.459240 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.459406 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.459537 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.459705 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.459843 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460011 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460149 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460317 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460467 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460648 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460780 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.460954 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.461098 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.461268 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.461397 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.461593 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.461726 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.461906 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462044 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462255 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462398 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462527 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462653 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462787 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.462906 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.463107 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.463238 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.463435 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.463572 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.463756 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.463895 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464071 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464202 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464370 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464582 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464712 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464838 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.464965 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.465090 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.465263 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.465402 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.465573 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.465710 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.465875 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466005 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466171 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466314 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466466 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466603 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466765 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.466895 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467062 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467200 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467360 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467490 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467656 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467785 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.467950 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.468091 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.468249 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.468379 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.468567 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.468699 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.469411 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.469550 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.469780 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.469909 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.470143 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.470271 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.470450 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.470581 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.470755 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.470888 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471057 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471198 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471364 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471496 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471666 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471805 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.471963 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.472100 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.472260 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.472491 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.472623 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.472759 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.472895 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473031 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473148 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473274 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473444 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473575 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473744 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.473885 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474047 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474178 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474348 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474478 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474682 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474812 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.474938 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475063 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475250 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475389 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475561 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475691 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.475994 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.476187 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.476317 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.476506 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.476638 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.476806 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.476937 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.477110 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.477237 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.477411 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.477549 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.477714 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.477845 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478016 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478161 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478320 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478449 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478637 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478765 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.478936 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479076 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479243 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479379 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479551 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479674 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479857 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.479996 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.480161 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.480289 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.480489 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.480624 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.480812 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.480948 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.481117 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.481254 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.481422 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.481556 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.481722 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.481850 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482024 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482156 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482327 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482472 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482674 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482807 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.482976 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483113 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483239 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483380 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483650 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483799 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.483930 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.484116 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.484255 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.484488 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.485189 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.485323 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.485590 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.485719 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.486141 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.486274 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.486458 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.486596 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.486769 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.486907 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.487081 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.487220 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.487405 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.487536 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.487727 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.487870 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488033 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488167 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488341 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488497 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488669 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488808 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.488936 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 14:16:44.489064 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.489313 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.489653 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.489979 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.490290 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.490601 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.490902 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:16:44.491141 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 14:16:44.643291 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Registered counter for database nova_api Aug 05 14:16:44.646223 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Registered counter for database nova_api Aug 05 14:16:44.664427 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.668084 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-5206054a-678e-49ac-9559-db977279c3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.671038 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.675258 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.726625 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.context [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),282df96a-f269-4d6d-8196-fcd51de3f20c(cell1) {{(pid=103537) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 14:16:44.730449 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:16:44.730741 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.context [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),282df96a-f269-4d6d-8196-fcd51de3f20c(cell1) {{(pid=103536) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 14:16:44.730918 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:16:44.732497 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:16:44.733290 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:16:44.733676 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:16:44.735075 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:16:44.735542 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:16:44.736719 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:16:44.737403 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:16:44.738126 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:16:44.738571 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:16:44.738688 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Registered counter for database nova_cell0 Aug 05 14:16:44.740595 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:16:44.742577 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Registered counter for database nova_cell0 Aug 05 14:16:44.744027 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Registered counter for database nova_cell1 Aug 05 14:16:44.747906 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Registered counter for database nova_cell1 Aug 05 14:16:44.753384 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.754566 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.755943 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-5206054a-678e-49ac-9559-db977279c3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.758020 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-5206054a-678e-49ac-9559-db977279c3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.760544 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.763171 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.766056 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.766500 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.907500 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Registered counter for database nova_cell0 Aug 05 14:16:44.911417 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Registered counter for database nova_cell0 Aug 05 14:16:44.914328 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.918513 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-5206054a-678e-49ac-9559-db977279c3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:16:44.919064 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:44.923382 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:16:45.337866 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:16:45.345785 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:16:45.369352 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-5206054a-678e-49ac-9559-db977279c3ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:16:45.376822 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:16:45.691973 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:16:45.697929 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:16:45.703223 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d0161b9c0 pid: 103537 (default app) Aug 05 14:16:45.705551 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:16:45.706736 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Aug 05 14:16:45.707158 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Fri Aug 5 14:16:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:16:45.716942 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-5206054a-678e-49ac-9559-db977279c3ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:16:45.723409 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-5206054a-678e-49ac-9559-db977279c3ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:16:45.728672 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d0161b9c0 pid: 103536 (default app) Aug 05 14:18:03.892174 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:03.893277 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 05 14:18:03.893664 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:03.905677 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=3 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:03.906524 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell1:SELECT=3 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:03.907227 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell0:SELECT=3 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:03.908502 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:04.743034 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-060f91af-a2f1-4fe6-9252-b6bafc7b5046 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:04.775369 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-060f91af-a2f1-4fe6-9252-b6bafc7b5046 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.874907 Aug 05 14:18:04.775927 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Aug 5 14:18:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:06.995212 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:06.996222 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-19304f0a-d4ee-46b8-abeb-8196a2a0cdfc None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 05 14:18:06.996732 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:07.481156 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1d148732-9877-4f7d-96c1-e07f2d144007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "id": "c1", "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:07.504303 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:18:07.504303 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 05 14:18:07.586717 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1d148732-9877-4f7d-96c1-e07f2d144007 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.582987 Aug 05 14:18:07.587521 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:18:07.803412 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-24e039c3-7430-4482-865a-1b805e05278f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:07.807724 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:18:07.807724 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 05 14:18:07.810481 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:07.811904 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:07.812933 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell1:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:07.813690 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:07.973129 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-24e039c3-7430-4482-865a-1b805e05278f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.377416 Aug 05 14:18:07.973944 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Aug 5 14:18:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:10.209117 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1d148732-9877-4f7d-96c1-e07f2d144007 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:10.210863 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1d148732-9877-4f7d-96c1-e07f2d144007 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Aug 05 14:18:10.211759 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:10.879420 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-6b9dc497-1102-41ba-94ef-a34e6c45ac36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:10.899749 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:18:10.899749 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 05 14:18:11.004468 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-6b9dc497-1102-41ba-94ef-a34e6c45ac36 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.786305 Aug 05 14:18:11.012374 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:18:11.017856 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-554baa23-f747-438e-9229-1ea7c18be925 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:11.020794 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:18:11.020794 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 05 14:18:11.135859 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-554baa23-f747-438e-9229-1ea7c18be925 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122145 Aug 05 14:18:11.136880 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Aug 5 14:18:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:13.360351 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-6b9dc497-1102-41ba-94ef-a34e6c45ac36 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:13.361391 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-6b9dc497-1102-41ba-94ef-a34e6c45ac36 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 05 14:18:13.361796 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:13.753401 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-7c9994db-cb9d-4a22-8577-fed0b5b60070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "name": "ds1G"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:13.827725 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-7c9994db-cb9d-4a22-8577-fed0b5b60070 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459872 Aug 05 14:18:13.828294 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:18:13.840170 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-465db75a-786d-4f2a-b52b-c6f924d01c07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:13.941411 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-465db75a-786d-4f2a-b52b-c6f924d01c07 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104712 Aug 05 14:18:13.941902 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Aug 5 14:18:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:16.155871 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-7c9994db-cb9d-4a22-8577-fed0b5b60070 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:16.157014 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-7c9994db-cb9d-4a22-8577-fed0b5b60070 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Aug 05 14:18:16.157490 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:16.628763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-dc79bac8-183c-4243-be62-8c403e01449d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:16.698211 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-dc79bac8-183c-4243-be62-8c403e01449d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534698 Aug 05 14:18:16.699119 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:18:16.712201 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-dd9fbb8f-f18a-475b-865d-28d512e7301a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:16.786108 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-dd9fbb8f-f18a-475b-865d-28d512e7301a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077877 Aug 05 14:18:16.786886 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Aug 5 14:18:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:19.000930 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-dc79bac8-183c-4243-be62-8c403e01449d admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:19.001939 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-dc79bac8-183c-4243-be62-8c403e01449d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 05 14:18:19.002633 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:19.457769 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-40065397-adec-4b0f-861b-e11d8012bc54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:19.543245 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-40065397-adec-4b0f-861b-e11d8012bc54 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534694 Aug 05 14:18:19.544061 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:18:19.556256 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-80588940-af73-4dca-a17f-e40fd1819622 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:19.660928 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-80588940-af73-4dca-a17f-e40fd1819622 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108154 Aug 05 14:18:19.661513 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Aug 5 14:18:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:21.865554 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-40065397-adec-4b0f-861b-e11d8012bc54 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:21.866565 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-40065397-adec-4b0f-861b-e11d8012bc54 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 05 14:18:21.866972 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:22.277888 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-d3910d34-511f-411d-b4bd-d3ade1b61bcf admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:22.302925 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-d3910d34-511f-411d-b4bd-d3ade1b61bcf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.429564 Aug 05 14:18:22.303412 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Aug 5 14:18:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:18:24.522292 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-40065397-adec-4b0f-861b-e11d8012bc54 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:24.523367 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-40065397-adec-4b0f-861b-e11d8012bc54 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Aug 05 14:18:24.523970 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:24.947194 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c77b6705-eba0-43c8-9fc3-2834d1fcec4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:25.034427 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c77b6705-eba0-43c8-9fc3-2834d1fcec4b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.503664 Aug 05 14:18:25.035060 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:18:25.047715 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-9d3866e6-042e-4522-a150-1a2e69445777 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:25.180740 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-9d3866e6-042e-4522-a150-1a2e69445777 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137149 Aug 05 14:18:25.181235 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Aug 5 14:18:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:27.351574 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c77b6705-eba0-43c8-9fc3-2834d1fcec4b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:27.352605 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c77b6705-eba0-43c8-9fc3-2834d1fcec4b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 05 14:18:27.353003 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:27.746885 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-45a2749b-4737-43d6-a58c-6e4b5dedda70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:27.825586 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-45a2749b-4737-43d6-a58c-6e4b5dedda70 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466807 Aug 05 14:18:27.826178 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:18:27.838855 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-6672f404-146e-4486-b9bf-3e9ca592ebe4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:27.944538 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-6672f404-146e-4486-b9bf-3e9ca592ebe4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109250 Aug 05 14:18:27.945130 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Aug 5 14:18:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:30.159272 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-45a2749b-4737-43d6-a58c-6e4b5dedda70 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:30.160290 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-45a2749b-4737-43d6-a58c-6e4b5dedda70 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 05 14:18:30.160797 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:30.561523 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-9131fec5-69dc-4510-8675-b02deb34d5d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "disk": 40, "swap": 0}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:30.660525 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-9131fec5-69dc-4510-8675-b02deb34d5d9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.493668 Aug 05 14:18:30.662041 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:18:30.674552 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-392c2016-44ee-41bb-be57-365ade6c4477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:30.813440 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-392c2016-44ee-41bb-be57-365ade6c4477 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142903 Aug 05 14:18:30.814117 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Aug 5 14:18:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:33.172755 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-9131fec5-69dc-4510-8675-b02deb34d5d9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:33.185150 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-9131fec5-69dc-4510-8675-b02deb34d5d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 05 14:18:33.185150 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:33.647471 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1c36d3c4-18c5-4e84-800a-bb805c3d45ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:33.732461 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1c36d3c4-18c5-4e84-800a-bb805c3d45ac admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.550248 Aug 05 14:18:33.733694 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:18:33.746436 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-eeb07aa1-7956-462f-8872-f0c7998a8835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:33.827412 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-eeb07aa1-7956-462f-8872-f0c7998a8835 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084669 Aug 05 14:18:33.828597 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Aug 5 14:18:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:36.099490 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1c36d3c4-18c5-4e84-800a-bb805c3d45ac admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:36.100681 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1c36d3c4-18c5-4e84-800a-bb805c3d45ac admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 05 14:18:36.101265 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:36.543516 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-39840d0f-e521-4a5d-b574-bf135c1a33ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:36.637263 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-39840d0f-e521-4a5d-b574-bf135c1a33ca admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.530067 Aug 05 14:18:36.638013 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Aug 5 14:18:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:18:36.650589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-eeb35b23-1cb7-4078-9f93-ab59dfb2a92f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:18:36.655570 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:36.728301 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-eeb35b23-1cb7-4078-9f93-ab59dfb2a92f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081459 Aug 05 14:18:36.728931 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Aug 5 14:18:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:18:57.842087 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-39840d0f-e521-4a5d-b574-bf135c1a33ca admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:57.843959 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-39840d0f-e521-4a5d-b574-bf135c1a33ca admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 05 14:18:57.844369 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:18:58.228396 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-b039b2a4-4e6d-4053-941a-d51c4d03a142 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:58.247050 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-b039b2a4-4e6d-4053-941a-d51c4d03a142 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396565 Aug 05 14:18:58.247598 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Aug 5 14:18:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:18:59.314927 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-39840d0f-e521-4a5d-b574-bf135c1a33ca admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:59.315928 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-39840d0f-e521-4a5d-b574-bf135c1a33ca admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 05 14:18:59.316319 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:18:59.831115 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-92d9a248-c635-494d-8635-9d265f6a4570 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:59.836691 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.wsgi [None req-92d9a248-c635-494d-8635-9d265f6a4570 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-92d9a248-c635-494d-8635-9d265f6a4570 admin admin] Request method failure captured: Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Accept: application/json Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Accept-Encoding: gzip, deflate Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Connection: keep-alive Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Content-Length: 0 Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Host: 10.222.0.26 Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Openstack-Api-Version: compute 2.90 Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Openstack-System-Scope: None Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: User-Agent: python-novaclient Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Auth-Token: gAAAAABi7SbTsbHF8rj-YaF__yP-HnW_dhVZE3VUh2UmJbOOFmqRkRsUsOKEmgsEdoTEeBQxEcaIZqTat4LdgGPeymv4Dq7gVee2xD0oollcorV8cWY2gO-I_vG_EX7XUYaFZ1sVX1h8S35fUqXX7gGTa6805qQ42ZZqSRBUFqaiW8JCVspc7PQ Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Domain-Id: None Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Domain-Name: None Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Identity-Status: Confirmed Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Is-Admin-Project: True Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Domain-Id: default Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Domain-Name: Default Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Name: admin Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Role: member,admin,reader Aug 05 14:18:59.839911 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Roles: member,admin,reader Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b40e0244e98a49699194b094ad410d1e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant: admin Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant-Name: admin Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User: admin Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Domain-Id: default Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Domain-Name: Default Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Id: 5e3fbbd9c18b4be39ebc01f40d1df40f Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Name: admin Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: method: > Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: exception: Flavor 42 could not be found. Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: action_args: {'id': '42'} Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:18:59.841742 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:18:59.843239 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.844702 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-92d9a248-c635-494d-8635-9d265f6a4570 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:18:59.845996 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-92d9a248-c635-494d-8635-9d265f6a4570 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386227 Aug 05 14:18:59.845996 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Aug 5 14:18:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 14:18:59.850995 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b67a2385-1bdc-42ce-b93d-907456685594 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:59.855044 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:18:59.874728 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b67a2385-1bdc-42ce-b93d-907456685594 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026464 Aug 05 14:18:59.875274 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Aug 5 14:18:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:18:59.884909 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-8a1985ea-c07c-4a7d-a416-f911b19039bf admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:59.908792 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-8a1985ea-c07c-4a7d-a416-f911b19039bf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027363 Aug 05 14:18:59.909340 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Aug 5 14:18:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:18:59.918529 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ce6b23f8-10a7-49b3-8a61-fb494d818291 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:18:59.925147 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-ce6b23f8-10a7-49b3-8a61-fb494d818291 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ce6b23f8-10a7-49b3-8a61-fb494d818291 admin admin] Request method failure captured: Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Accept: application/json Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Connection: keep-alive Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Content-Length: 0 Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Host: 10.222.0.26 Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABi7SbTsbHF8rj-YaF__yP-HnW_dhVZE3VUh2UmJbOOFmqRkRsUsOKEmgsEdoTEeBQxEcaIZqTat4LdgGPeymv4Dq7gVee2xD0oollcorV8cWY2gO-I_vG_EX7XUYaFZ1sVX1h8S35fUqXX7gGTa6805qQ42ZZqSRBUFqaiW8JCVspc7PQ Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Domain-Id: None Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Domain-Name: None Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Name: admin Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Role: member,admin,reader Aug 05 14:18:59.928484 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Roles: member,admin,reader Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b40e0244e98a49699194b094ad410d1e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant: admin Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User: admin Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Id: 5e3fbbd9c18b4be39ebc01f40d1df40f Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Name: admin Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: method: > Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: exception: Flavor 42 could not be found. Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: action_args: {'id': '42'} Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:18:59.938892 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:18:59.939863 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:18:59.941166 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ce6b23f8-10a7-49b3-8a61-fb494d818291 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:18:59.942557 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-ce6b23f8-10a7-49b3-8a61-fb494d818291 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014864 Aug 05 14:18:59.942557 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Aug 5 14:18:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 14:19:00.896439 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-8a1985ea-c07c-4a7d-a416-f911b19039bf admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:00.897451 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-8a1985ea-c07c-4a7d-a416-f911b19039bf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 05 14:19:00.897843 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:01.422691 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c18c331b-c0cc-4f67-b3ad-02e3607358bf admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:01.430261 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-c18c331b-c0cc-4f67-b3ad-02e3607358bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c18c331b-c0cc-4f67-b3ad-02e3607358bf admin admin] Request method failure captured: Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Accept: application/json Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Connection: keep-alive Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Content-Length: 0 Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Host: 10.222.0.26 Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABi7SbUw3nER_Nk2Jv7-FpoGq6bbmetiPEHfwdqDFbC4v6DdIAue5HaLocjoKWH7hKQ9jboZmhQV38MkxLf-7x1ALNY9codBdDcTAIMdbBnyitH-K-O5RoGcZFXJtplwdFGw6UrKhbKUA66iJ-y1_pd9OuBkSf_RsNw5vTK8hhpHnIpff4 Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Domain-Id: None Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Domain-Name: None Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Name: admin Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Role: member,admin,reader Aug 05 14:19:01.431740 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Roles: member,admin,reader Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b40e0244e98a49699194b094ad410d1e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant: admin Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User: admin Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Id: 5e3fbbd9c18b4be39ebc01f40d1df40f Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Name: admin Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: method: > Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: exception: Flavor 84 could not be found. Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: action_args: {'id': '84'} Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:19:01.433515 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:01.437451 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.438763 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c18c331b-c0cc-4f67-b3ad-02e3607358bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:19:01.440022 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c18c331b-c0cc-4f67-b3ad-02e3607358bf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395911 Aug 05 14:19:01.440022 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Aug 5 14:19:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 14:19:01.442885 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1272883d-b77c-4770-a2ed-9c7fafbdf3d5 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:01.458397 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1272883d-b77c-4770-a2ed-9c7fafbdf3d5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018967 Aug 05 14:19:01.458930 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Aug 5 14:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:19:01.468894 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-d5dd31d0-5aaa-449f-b570-914846c55076 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:01.483888 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-d5dd31d0-5aaa-449f-b570-914846c55076 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019119 Aug 05 14:19:01.484376 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Aug 5 14:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:19:01.493681 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1193f283-6ff9-4099-8d6a-8ed325650815 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:01.499223 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.wsgi [None req-1193f283-6ff9-4099-8d6a-8ed325650815 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1193f283-6ff9-4099-8d6a-8ed325650815 admin admin] Request method failure captured: Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Accept: application/json Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Accept-Encoding: gzip, deflate Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Connection: keep-alive Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Content-Length: 0 Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Host: 10.222.0.26 Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Openstack-Api-Version: compute 2.90 Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Openstack-System-Scope: None Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: User-Agent: python-novaclient Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Auth-Token: gAAAAABi7SbUw3nER_Nk2Jv7-FpoGq6bbmetiPEHfwdqDFbC4v6DdIAue5HaLocjoKWH7hKQ9jboZmhQV38MkxLf-7x1ALNY9codBdDcTAIMdbBnyitH-K-O5RoGcZFXJtplwdFGw6UrKhbKUA66iJ-y1_pd9OuBkSf_RsNw5vTK8hhpHnIpff4 Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Domain-Id: None Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Domain-Name: None Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Identity-Status: Confirmed Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Is-Admin-Project: True Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Domain-Id: default Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Domain-Name: Default Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Name: admin Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Role: member,admin,reader Aug 05 14:19:01.500589 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Roles: member,admin,reader Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b40e0244e98a49699194b094ad410d1e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant: admin Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant-Name: admin Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User: admin Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Domain-Id: default Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Domain-Name: Default Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Id: 5e3fbbd9c18b4be39ebc01f40d1df40f Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Name: admin Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: method: > Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: exception: Flavor 84 could not be found. Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: action_args: {'id': '84'} Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:19:01.502080 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:01.502940 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:01.504069 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1193f283-6ff9-4099-8d6a-8ed325650815 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:19:01.505100 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1193f283-6ff9-4099-8d6a-8ed325650815 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011864 Aug 05 14:19:01.505100 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Aug 5 14:19:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 05 14:19:02.461582 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-d5dd31d0-5aaa-449f-b570-914846c55076 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:02.462615 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-d5dd31d0-5aaa-449f-b570-914846c55076 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 05 14:19:02.463036 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:02.980631 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-f3ab2662-7704-462b-905f-d5b65e14f923 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:02.986682 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.wsgi [None req-f3ab2662-7704-462b-905f-d5b65e14f923 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-f3ab2662-7704-462b-905f-d5b65e14f923 admin admin] Request method failure captured: Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Accept: application/json Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Accept-Encoding: gzip, deflate Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Connection: keep-alive Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Content-Length: 0 Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Host: 10.222.0.26 Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Openstack-Api-Version: compute 2.90 Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Openstack-System-Scope: None Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: User-Agent: python-novaclient Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Auth-Token: gAAAAABi7SbWMuIFaBAqv8Om5khlhxp8jJ_gsMIvDRC2Bqdb1MbaXGiLzi8DWkxM2lwiHK_PSFwZgIw9ZSliLM5aWAhT83NqsUUKFPtKDs9rNaYmzu5ou0-Hgpz3hdP1v0eO38LO1sY4DIh9VuSYCkSOwWxp9qsLZq1wMVMSvWiT4SJTKFNWwCg Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Domain-Id: None Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Domain-Name: None Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Identity-Status: Confirmed Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Is-Admin-Project: True Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Domain-Id: default Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Domain-Name: Default Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Project-Name: admin Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Role: member,admin,reader Aug 05 14:19:02.988155 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Roles: member,admin,reader Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b40e0244e98a49699194b094ad410d1e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant: admin Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-Tenant-Name: admin Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User: admin Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Domain-Id: default Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Domain-Name: Default Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Id: 5e3fbbd9c18b4be39ebc01f40d1df40f Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: X-User-Name: admin Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: method: > Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: exception: Flavor 451 could not be found. Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: action_args: {'id': '451'} Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:19:02.989737 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:02.991339 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 05 14:19:02.992639 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-f3ab2662-7704-462b-905f-d5b65e14f923 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:19:02.993886 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-f3ab2662-7704-462b-905f-d5b65e14f923 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388015 Aug 05 14:19:02.993886 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Aug 5 14:19:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 14:19:02.999635 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-a97e80d9-b9e1-4365-a57f-4108f667f6bb admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:03.015151 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-a97e80d9-b9e1-4365-a57f-4108f667f6bb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018914 Aug 05 14:19:03.015833 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Aug 5 14:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:19:03.025509 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:03.040894 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018887 Aug 05 14:19:03.041426 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Aug 5 14:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:19:03.050624 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-32a8f626-bcc5-45b4-b889-e60b069b37b4 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:03.055843 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-32a8f626-bcc5-45b4-b889-e60b069b37b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-32a8f626-bcc5-45b4-b889-e60b069b37b4 admin admin] Request method failure captured: Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Accept: application/json Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Connection: keep-alive Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Content-Length: 0 Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Host: 10.222.0.26 Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABi7SbWMuIFaBAqv8Om5khlhxp8jJ_gsMIvDRC2Bqdb1MbaXGiLzi8DWkxM2lwiHK_PSFwZgIw9ZSliLM5aWAhT83NqsUUKFPtKDs9rNaYmzu5ou0-Hgpz3hdP1v0eO38LO1sY4DIh9VuSYCkSOwWxp9qsLZq1wMVMSvWiT4SJTKFNWwCg Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Domain-Id: None Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Domain-Name: None Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Project-Name: admin Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Role: member,admin,reader Aug 05 14:19:03.057339 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Roles: member,admin,reader Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b40e0244e98a49699194b094ad410d1e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b40e0244e98a49699194b094ad410d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant: admin Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant-Id: b40e0244e98a49699194b094ad410d1e Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User: admin Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Id: 5e3fbbd9c18b4be39ebc01f40d1df40f Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: X-User-Name: admin Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: method: > Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: exception: Flavor 451 could not be found. Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: action_args: {'id': '451'} Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:19:03.058878 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:03.059844 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 05 14:19:03.061157 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-32a8f626-bcc5-45b4-b889-e60b069b37b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:19:03.062520 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-32a8f626-bcc5-45b4-b889-e60b069b37b4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011529 Aug 05 14:19:03.062520 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Aug 5 14:19:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 05 14:19:04.023299 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:04.024314 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 05 14:19:04.024740 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:04.557368 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ec2c1b14-2ab4-442b-ba16-12ca56949f06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:19:04.615072 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-ec2c1b14-2ab4-442b-ba16-12ca56949f06 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.451936 Aug 05 14:19:04.615630 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Aug 5 14:19:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:19:05.577566 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:05.578610 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Aug 05 14:19:05.579015 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:06.094474 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-84fca753-ff55-47c0-9a49-6efe1fc53521 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:19:06.188821 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-84fca753-ff55-47c0-9a49-6efe1fc53521 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.471411 Aug 05 14:19:06.189373 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Aug 5 14:19:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:19:07.175835 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:07.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 05 14:19:07.177313 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:07.691593 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-02092cc7-5c23-40ab-81a6-72bbabf7215a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:19:07.789122 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-02092cc7-5c23-40ab-81a6-72bbabf7215a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.474203 Aug 05 14:19:07.789659 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Aug 5 14:19:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:19:08.757875 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:08.758875 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 05 14:19:08.759282 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:09.276785 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-20848228-e4fd-4524-91ff-11d809422cb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:19:09.357600 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-20848228-e4fd-4524-91ff-11d809422cb1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458199 Aug 05 14:19:09.358550 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Aug 5 14:19:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:19:10.324652 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:10.325663 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 05 14:19:10.326068 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:19:10.853015 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-98d3d69f-cd4d-4f63-9a4e-d40fc52b06a4 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:19:10.874095 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-98d3d69f-cd4d-4f63-9a4e-d40fc52b06a4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410532 Aug 05 14:19:10.874828 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Fri Aug 5 14:19:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:20:02.963225 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:20:02.964235 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-453d9a1e-ed9a-4858-8e8c-48c9b7de64a9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 05 14:20:02.964680 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Fri Aug 5 14:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:20:02.975598 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:20:03.358563 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-d69b67b8-a6fc-4a1e-8420-8f054851b981 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:20:03.379333 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-d69b67b8-a6fc-4a1e-8420-8f054851b981 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408074 Aug 05 14:20:03.379809 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Aug 5 14:20:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:20:03.403810 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-375fe932-dfcd-4bc3-916b-b37a047b6ae2 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:20:03.407305 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:20:03.412283 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-375fe932-dfcd-4bc3-916b-b37a047b6ae2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012742 Aug 05 14:20:03.412852 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Fri Aug 5 14:20:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:20:03.424358 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-6e4de885-05f8-45c3-8465-474495cd50d1 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:20:03.432026 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-6e4de885-05f8-45c3-8465-474495cd50d1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011252 Aug 05 14:20:03.432560 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Fri Aug 5 14:20:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:20:03.444634 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:20:03.452808 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011693 Aug 05 14:20:03.453331 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Fri Aug 5 14:20:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:20:03.464637 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-3839a3c8-4b2d-4d26-8bf2-bcbafc7853c4 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:20:03.472745 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-3839a3c8-4b2d-4d26-8bf2-bcbafc7853c4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011642 Aug 05 14:20:03.475249 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Fri Aug 5 14:20:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:23:12.684987 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:12.686001 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 05 14:23:12.686402 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:23:12.826626 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=6 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:23:12.984477 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:12.986765 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:23:12.986765 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 05 14:23:12.987955 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:12.988471 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:12.994008 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:12.994008 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:12.994008 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:12.994008 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:13.025900 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7ad505a0-1337-4a74-b97c-dd26b374eb8b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200831 Aug 05 14:23:13.026462 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Aug 5 14:23:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:23:13.856678 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:13.857732 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 05 14:23:13.858125 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:23:14.049357 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:14.051842 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:23:14.051842 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 05 14:23:14.052998 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:14.053468 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:14.053923 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:14.054647 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:14.055073 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:14.055489 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:14.074849 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-148bc5d7-af53-4d95-924a-69b35afdc6d3 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076892 Aug 05 14:23:14.075331 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Aug 5 14:23:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:23:25.317386 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:25.318408 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 05 14:23:25.318781 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:23:25.463688 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=4 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:23:25.464334 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell1:SELECT=4 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:23:25.464983 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=8 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:23:25.517232 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:25.519609 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:23:25.519609 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 05 14:23:25.520737 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:25.521206 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:25.521658 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:25.522359 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:25.522799 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:25.523388 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:25.549276 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-ece3b724-c7b1-43bc-8b57-af16edffad7c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090295 Aug 05 14:23:25.549835 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Aug 5 14:23:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:23:26.376662 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:26.377663 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6e5b462f-1e9c-44c0-a21b-a349c3ddcaef admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 05 14:23:26.378065 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Aug 5 14:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:23:26.568791 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:23:26.571207 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 14:23:26.571207 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 05 14:23:26.572306 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:26.572811 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:26.573294 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:26.573996 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:23:26.574543 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:23:26.574966 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:23:26.596516 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-69acad13-8f73-48f4-a35a-e0bae3049bd8 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080532 Aug 05 14:23:26.597006 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Aug 5 14:23:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:24:24.648971 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: Fri Aug 5 14:24:24 2022 - graceful shutdown triggered... Aug 05 14:24:24.649266 dv-cinder-802955-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 14:24:24.650037 dv-cinder-802955-8-iscsi devstack@n-api.service[103536]: Gracefully killing worker 1 (pid: 103536)... Aug 05 14:24:24.650480 dv-cinder-802955-8-iscsi devstack@n-api.service[103537]: Gracefully killing worker 2 (pid: 103537)... Aug 05 14:24:25.650608 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: worker 1 buried after 1 seconds Aug 05 14:24:25.651029 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: worker 2 buried after 1 seconds Aug 05 14:24:25.651029 dv-cinder-802955-8-iscsi devstack@n-api.service[103535]: goodbye to uWSGI. Aug 05 14:24:25.652175 dv-cinder-802955-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 14:24:25.652802 dv-cinder-802955-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 14:24:25.655674 dv-cinder-802955-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 14:24:25.666285 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 14:24:25.669119 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 14:24:25 2022] *** Aug 05 14:24:25.669741 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 14:24:25.669973 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 14:24:25.670115 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: nodename: dv-cinder-802955-8-iscsi Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: machine: x86_64 Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: clock source: unix Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: pcre jit disabled Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: detected number of CPU cores: 4 Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: current working directory: / Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: detected binary path: /usr/bin/uwsgi-core Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: your processes number limit is 47680 Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: your memory page size is 4096 bytes Aug 05 14:24:25.670348 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: detected max file descriptor number: 2048 Aug 05 14:24:25.671066 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: lock engine: pthread robust mutexes Aug 05 14:24:25.671066 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: thunder lock: enabled Aug 05 14:24:25.671066 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 14:24:25.671066 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 14:24:25.714426 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: Python main interpreter initialized at 0x562c4a99e9c0 Aug 05 14:24:25.714426 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: python threads support enabled Aug 05 14:24:25.714426 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: your server socket listen backlog is limited to 100 connections Aug 05 14:24:25.714426 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: your mercy for graceful operations on workers is 90 seconds Aug 05 14:24:25.714890 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 14:24:25.714890 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: *** Operational MODE: preforking *** Aug 05 14:24:25.715143 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: *** uWSGI is running in multiple interpreter mode *** Aug 05 14:24:25.715143 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: spawned uWSGI master process (pid: 118034) Aug 05 14:24:25.715362 dv-cinder-802955-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 14:24:25.715987 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: spawned uWSGI worker 1 (pid: 118052, cores: 1) Aug 05 14:24:25.716304 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: spawned uWSGI worker 2 (pid: 118053, cores: 1) Aug 05 14:24:25.716707 dv-cinder-802955-8-iscsi devstack@n-api.service[118034]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 14:24:26.380081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 14:24:26.380744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 14:24:27.537641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:24:27.537641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: from cryptography.utils import int_from_bytes Aug 05 14:24:27.538264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:24:27.538264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: from cryptography.utils import int_from_bytes Aug 05 14:24:27.569413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:24:27.569413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: from cryptography.utils import int_from_bytes Aug 05 14:24:27.570014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 14:24:27.570014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: from cryptography.utils import int_from_bytes Aug 05 14:24:29.866338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 14:24:29.867405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 14:24:29.867707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 14:24:29.868056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 14:24:29.868352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 14:24:29.868763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.869089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.869411 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.869729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.870061 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.870372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.870690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.871010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.871337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.871602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.871922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.872248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-8-iscsi {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.872593 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.872902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.873214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.873532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.873836 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.874156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.874469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.874964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.875398 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.875706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.876018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.876360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.876756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.877068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.877392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.877702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.878027 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.878334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.878733 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-8-iscsi {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.879050 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.879360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.879671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.880080 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.880387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.880730 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.881032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.881356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.881693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.882001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.882320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.883257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.883586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.883890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.884202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.884554 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.884878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.885726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.885726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.885726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.886087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.886337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.886666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.886988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.887240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.887489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.887809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.888133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.888462 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.888779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.889083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.889548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.890018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.890331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.890643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.890952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.891277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.891603 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.891938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.892249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.892602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.893003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.893257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.893567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.893906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.894229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.894539 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.894859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.895180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.895489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.895796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.896103 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.896441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.896779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.897086 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.897337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.897638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.897944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.898947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.899273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.899583 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.899883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.900182 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.900519 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.900827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.901131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.901437 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.901748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.902050 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.902354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.902659 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.902963 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.903279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.903596 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.903900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.904202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.904378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 14:24:29.904862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.904970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 14:24:29.905078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.905167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.905254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 14:24:29.905415 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.905529 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 14:24:29.905720 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.905864 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 14:24:29.906039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.906174 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.906342 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.906621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.906765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.906899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907451 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907581 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.907860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908625 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.908929 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.909090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.909234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.909374 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.909505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-8-iscsi {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.909648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.909863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910324 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910606 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.910999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.911137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.911303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.911470 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.911603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.911740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.911931 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.912101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.912264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.912403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.912591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.912785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.913011 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.913156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.913302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.913467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.913590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.913702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.914469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.914669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.914803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.914915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.915113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.915244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.915442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.915578 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.915758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.915879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.916151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.916270 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-8-iscsi {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.916491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.916631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.916805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.916931 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.917121 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.917242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.917433 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.917553 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.917745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.917872 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.918122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.918252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.918375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.918488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.918682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.918805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.919054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.919385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.919704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.919836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.920025 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.920139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.920346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.920558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.920718 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.920817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.920974 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.921081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.921288 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.921519 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.921620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.921696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.921930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.922094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.922261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.922417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.922565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.922711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.922857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.923008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.923170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.923317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.923473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.923619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.923770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.923926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.924084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.924242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.924397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.924588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.924737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.924896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.925052 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.925198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.925353 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.925506 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.925764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.925979 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.926139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.926291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.926445 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.926598 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.926752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.926911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.927064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.927210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.927366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.927519 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.927664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.927818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.927964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.928115 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.928261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.928406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.928589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.928743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.928888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.929048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.929193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.929193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.929731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.929731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.930026 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.930184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.930330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.930475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.930633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.930787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.930933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.931092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.931238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.931391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.931604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.931764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.931917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.932147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.932307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.932491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.932653 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.932800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.933070 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.933245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.933395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.933555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.933709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.933873 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.934019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.934166 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.934318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.934473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.934704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.934853 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.934998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.935151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.935297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.935454 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.935607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.935870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.936047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.936195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.936355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.936532 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.936697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.936852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.936998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.937143 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.937302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.937456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.937618 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.937777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.937942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.938096 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.938243 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.938398 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.938545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.938697 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.938843 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.938996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.939142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.939301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.939468 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.939832 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.939987 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.940146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.940300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.940573 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.940736 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.940892 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.941046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.941192 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.941344 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.941503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.941700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.941859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.942019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.942204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.942204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.942570 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.942724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.942870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.943024 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.943170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.943315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.943459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.943605 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.943759 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.943912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.944058 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.944210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.944374 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.944558 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.944718 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.944864 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.945031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.945208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.945355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.945507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.945668 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.945823 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.946080 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.946233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.946390 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.946544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.946701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.946855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.947000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.947144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.947289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.947514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.947670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.947817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.947961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.948125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.948125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.948526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.948685 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.948833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.948979 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.949131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.949276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.949434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.949580 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.949953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.950116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.950274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.950481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 14:24:29.950643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.950801 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.950960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.951113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.951266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.951425 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.951572 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.951763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.951922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.952077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.952225 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.952379 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.952674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.952840 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.952995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.953147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.953300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.953459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.953605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.953750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.953895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.954949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955105 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955548 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.955998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.956253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.956426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.956582 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.956745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.956902 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957519 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.957984 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.958139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.958285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.958437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.958592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.958747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.958916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.959070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.959216 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.959368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.959521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.959521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.959839 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.960194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.960349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.960518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.961183 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.961359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.961507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.961670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.961862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.962013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.962158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.962311 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.962465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.962698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.962859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963183 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.963992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.964146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.964293 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.964491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.964655 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.964801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.964946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.965996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.966150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.966405 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.966567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.966714 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.966868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.967015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.967167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.967313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.967466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.967755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.967971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.968143 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.968299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.968466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.968620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.968767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.968924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.969070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.969223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.969375 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.969520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.969672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.969828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.970013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.970379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.970787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.970940 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.971092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.971257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.971412 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.971566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.971718 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.971911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.972078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.972233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.972385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.972618 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.972857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973169 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973773 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.973927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.974999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.975152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.975298 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.975441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.975585 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.975748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.975905 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.976052 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.976206 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.977202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.977424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.977586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.977586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.977863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.977863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.978147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.978300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.978455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.978601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.978753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.978899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.979044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.979269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.979428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.979574 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.979718 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.979871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.980749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.981888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.981888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.981888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.982362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.982510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.982662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.982831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983813 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.983967 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.984124 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.984270 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.984487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.984641 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.984786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.984944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.985090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.985234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.985391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.985563 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.985717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.985870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986460 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.986893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.987052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.987322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.987484 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.987654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.987808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.987961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.988108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.988263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.988426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.988592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.988757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.989451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.989609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.989609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.989609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.989609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.990187 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.990362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.990765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.990929 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.991077 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.991230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.991387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.991387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.991685 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.991843 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.992035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.992035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.992370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.992370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.992708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.992857 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993416 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993416 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.993993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.994282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.994496 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.994647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.994800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.994945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995181 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995181 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995417 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995794 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.995908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.996035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.996150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.996270 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.996392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.996533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:29.996533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.003760 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.003922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.004072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.004230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.004426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.004645 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.004806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.004964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.005118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.005266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.005413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.005568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.005721 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.005909 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.006069 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.006224 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.006371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.006565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.006718 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.006872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.007030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.007176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.007336 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.007517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.007789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.007946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.008208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.008514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.008764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.008998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.009157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.009313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.009460 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.009628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.009786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.009978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.010138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.010295 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.010450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.010641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.011092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.011363 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.011528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.011678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.011825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.011971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.012151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.012345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.012345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.012662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.014592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.014806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.014973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.015124 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.015272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.015430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.015578 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.015739 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.015888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.016047 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.016202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.016357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.016541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.016706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.016896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017050 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017197 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.017966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.018113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.018363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.018737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.018924 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.019193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.019448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.019624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.019624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.019924 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.020072 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.020225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.020372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.020556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.020716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.021187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.021373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.021639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.021801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.021950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.022104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.022261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.022459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.022612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.022800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.022990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.023697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.023923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.024075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.024222 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.024378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.024562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.024726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.024874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025166 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025627 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.025947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.026230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.026385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.026540 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.026693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.026840 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027036 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027511 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027822 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.027976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.028129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.028290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.028290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.028914 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.029069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.029307 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.029469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.029646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.029646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.030995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.031355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.031488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.031614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.031728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.031842 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.031991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.032206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.032326 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.035915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.036080 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.036229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.036386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.036662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.036812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037827 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.037989 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.038183 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.038355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.038533 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.039760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.039942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.040117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.040272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.040504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.040667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.040868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.041035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.041202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.041609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.041822 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.041984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.042145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.042145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.042619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.042791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.042986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.043183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.043342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.043569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.043737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.043939 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.044202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.044371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.044564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.044728 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.044889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.045089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.045248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.045401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.045553 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.045713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.045866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.046074 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.046233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.046402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047192 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047529 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.047997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.048337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.048577 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.048734 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.049015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.049292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.049461 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.049624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.050025 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.050198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.050361 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.050525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.050679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.050839 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.051003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.051203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.051384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.051806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.051967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.052130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.052338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.052677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.052851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053006 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053660 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.053990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.054168 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.054472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.054662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.054903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.055070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.055223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.055384 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.055547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.055710 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.055870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.056023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.056175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.056386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.056606 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.056760 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.056913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.057075 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.057229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.057391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.057590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.057755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.057916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.058077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.058238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.058405 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.058568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.058764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.058925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.059175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.059430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.059601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.059790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.060051 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.060051 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.066559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.066771 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.066977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.067158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.067324 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.067479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.067631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.067797 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.067951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.068212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.068392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.068589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.068744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.068911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.069065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.069311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.069575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.069775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.069947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.070817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071217 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.071650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.073393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.074742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.075858 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.076027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.076027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.076370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.076550 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.076716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.076870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077361 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.077801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.078708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.078708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.079004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.079197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.079443 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.079722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.080440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.080741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.080916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081073 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.081241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.082772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.082980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.083152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.083437 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.083605 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.083759 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.083921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.084084 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.084247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.084450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.084615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.084854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.085015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.085170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.085335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.085335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.085729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.086569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.086740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.086740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.087040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.087196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.087357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.087517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.087677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.087838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.088002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.088175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.088330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.088559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.088767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.088937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.089100 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.089262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.089434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.089680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.089916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.090087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.090087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.090387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.090560 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.090714 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.090964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.091946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.093121 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.093290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.093473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.097451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.097628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.097795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.097955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.098121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.098294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.098482 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.098649 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.098767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.098891 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099016 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099582 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.099956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.100178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.100308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.100464 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.100648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.100648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.110871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.111160 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.111490 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.111490 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.111796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.111980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.112557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.112751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.112909 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.113063 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.113286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.114062 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.114252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.114413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.114592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.114748 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.114959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.115162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.115434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.115637 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.116254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.116499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.116693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.116889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.117062 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.117248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.117415 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.117592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.117796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.117967 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.118137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.119120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.119325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.119606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.119819 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.120071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.120377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.120611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.120772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.120925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.121084 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.121381 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.121553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.121727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.121883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.122037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.122189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.122351 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.122520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.122696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.122860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.123014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.123174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.123393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.123563 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.123737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.124193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.124519 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.124682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.124844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125166 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125804 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.125959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.126112 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.126273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.126434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.126587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.126750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.133926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.134381 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.134545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.134644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.134735 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.134837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.134937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135415 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135785 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.135977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.136921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137607 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.137995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138412 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138882 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138978 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.138978 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139381 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139576 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.139969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.140067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.140400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.140651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.140751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.140840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.140927 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141121 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.141930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142016 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142102 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142386 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142570 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.142975 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143267 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.143453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144810 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.144905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145168 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145777 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.145950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146130 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146226 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146581 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146705 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.146979 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147074 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.147981 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.148070 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.148214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.148829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149222 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149310 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149675 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149857 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.149953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.150129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.150223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.150517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.150624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.150788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.150901 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.151953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152731 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.152911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153394 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153490 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153858 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.153934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154703 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.154942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155190 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155271 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.155970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156641 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.156938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157411 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157494 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157649 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.157976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158050 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158123 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158578 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158578 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158720 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.158957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.159968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.160070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.160159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.160246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.160340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.162743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.162898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163281 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163554 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.163755 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.164747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.165932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166032 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.166929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167105 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167281 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167627 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.167908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.168929 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169539 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169641 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169731 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.169905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170804 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.170907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171098 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.171996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172351 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172742 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.172916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173099 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173275 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173457 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173457 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.173965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174561 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.174993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175383 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.175923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176842 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.176931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177027 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.177400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.178775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.179518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.181081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.182785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 14:24:30.183880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 14:24:30.306574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO dbcounter [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Registered counter for database nova_api Aug 05 14:24:30.326352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_db.sqlalchemy.engines [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.328727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO dbcounter [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Registered counter for database nova_api Aug 05 14:24:30.332986 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writer thread running {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.349017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_db.sqlalchemy.engines [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.356588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writer thread running {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.389532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.context [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),282df96a-f269-4d6d-8196-fcd51de3f20c(cell1) {{(pid=118053) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 14:24:30.393515 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:24:30.393987 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:24:30.395571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:24:30.396301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:24:30.396775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:24:30.399389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:24:30.401428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO dbcounter [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Registered counter for database nova_cell0 Aug 05 14:24:30.405487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO dbcounter [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Registered counter for database nova_cell1 Aug 05 14:24:30.412739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_db.sqlalchemy.engines [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.414645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.context [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),282df96a-f269-4d6d-8196-fcd51de3f20c(cell1) {{(pid=118052) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 14:24:30.415153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_db.sqlalchemy.engines [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.418897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:24:30.419376 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:24:30.420620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writer thread running {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.421010 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:24:30.421746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:24:30.422197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:24:30.424195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:24:30.425772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writer thread running {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.426229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO dbcounter [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Registered counter for database nova_cell0 Aug 05 14:24:30.430302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO dbcounter [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Registered counter for database nova_cell1 Aug 05 14:24:30.437437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_db.sqlalchemy.engines [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.439116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_db.sqlalchemy.engines [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.445204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writer thread running {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.447015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writer thread running {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.569504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO dbcounter [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Registered counter for database nova_cell0 Aug 05 14:24:30.576131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_db.sqlalchemy.engines [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.581844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writer thread running {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.595478 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO dbcounter [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Registered counter for database nova_cell0 Aug 05 14:24:30.605876 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_db.sqlalchemy.engines [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 14:24:30.610339 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writer thread running {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 14:24:30.900492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: WARNING keystonemiddleware.auth_token [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:24:30.911158 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: WARNING keystonemiddleware.auth_token [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:24:30.934728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: WARNING keystonemiddleware.auth_token [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:24:30.942091 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: WARNING keystonemiddleware.auth_token [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:24:31.251826 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: WARNING keystonemiddleware.auth_token [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:24:31.258366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: WARNING keystonemiddleware.auth_token [None req-494e92ab-a3e7-4b41-9149-5503641a1e57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:24:31.264609 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c4a99e9c0 pid: 118053 (default app) Aug 05 14:24:31.288369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: WARNING keystonemiddleware.auth_token [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 14:24:31.294435 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: WARNING keystonemiddleware.auth_token [None req-e42faad5-69eb-4093-9506-206f164ec6c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 14:24:31.300903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c4a99e9c0 pid: 118052 (default app) Aug 05 14:25:08.733581 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:08.734733 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:08.735910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:08.736848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:10.650193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-53641cce-513d-434b-889d-53031a271581 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Action: 'create', calling method: .version_select at 0x7fa75fb77e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1168442653"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:13.044925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-53641cce-513d-434b-889d-53031a271581 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.335982 Aug 05 14:25:13.049731 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Fri Aug 5 14:25:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4342 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 14:25:13.067260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:13.069606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:13.072860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:13.077096 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:13.675339 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-62fa0eba-9553-47f7-a8af-1ad937a5bd9d tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75fb3b8b0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:15.884394 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-62fa0eba-9553-47f7-a8af-1ad937a5bd9d tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366" status: 200 len: 346 microversion: 2.1 time: 2.823350 Aug 05 14:25:15.886028 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:13 2022] GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 => generated 346 bytes in 2826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:15.900429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bdcdc3a5-83e8-4927-844e-b137d77eaaa9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Action: 'create', calling method: .version_select at 0x7fa75f943c10>, body: {"snapshot": {"volume_id": "66593816-9871-41ff-a20a-3c6d7c58f366", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1624175546"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:16.191758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-781828510", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:16.447680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] validate_networks() for [('01b7a00e-6b5a-4e1c-b9ad-35ae3b9e3f0e', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:25:16.622734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bdcdc3a5-83e8-4927-844e-b137d77eaaa9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.728083 Aug 05 14:25:16.623957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1162 bytes} [Fri Aug 5 14:25:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:16.636269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ae44401c-60db-442a-b7d1-84d3e1ac4129 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f955e50>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:16.802828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ae44401c-60db-442a-b7d1-84d3e1ac4129 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.168012 Aug 05 14:25:16.802828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:16 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:16.812753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ed65bbd8-5066-4307-8fa1-3dad1788736e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f95d4c0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:16.942379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ed65bbd8-5066-4307-8fa1-3dad1788736e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.134832 Aug 05 14:25:16.944349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 4/5] 10.222.0.26 () {58 vars in 1140 bytes} [Fri Aug 5 14:25:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:16.959894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-775124ad-e195-468e-8bff-9d7c4747f922 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f955280>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:17.034648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-775124ad-e195-468e-8bff-9d7c4747f922 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.083080 Aug 05 14:25:17.039613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 5/6] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:16 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:18.054628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-13830552-d88d-400d-a7b0-b8e8a1d7fbbf tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f943c10>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:18.107299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-13830552-d88d-400d-a7b0-b8e8a1d7fbbf tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.057502 Aug 05 14:25:18.107299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 6/7] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:18 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:18.441198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:25:18.441663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:25:18.442240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:25:18.442897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:25:18.443952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:25:18.465539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:18.466178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:18.466716 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:18.467540 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:18.468199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:18.469206 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:18.530217 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:18.557031 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for user b9d62fe4e6de4308a3a51be3e900625f and project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:18.578179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:25:18.583812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:25:18.879619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cd72e167-4206-4293-9d0c-f4c25bea2ff4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.861089 Aug 05 14:25:18.879619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 2/8] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:25:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:25:18.887184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f4e21c93-ccb6-4d11-8ec2-40893601777d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:18.888035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f4e21c93-ccb6-4d11-8ec2-40893601777d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:19.125033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-46b32932-af8c-42d9-808a-f15029bdeb24 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f053790>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:19.200611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-46b32932-af8c-42d9-808a-f15029bdeb24 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.087025 Aug 05 14:25:19.206137 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 3/9] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:19 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:19.246043 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f4e21c93-ccb6-4d11-8ec2-40893601777d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:19.276376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f4e21c93-ccb6-4d11-8ec2-40893601777d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1221 microversion: 2.1 time: 0.393041 Aug 05 14:25:19.280540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 7/10] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:18 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1221 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:20.061619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1938676852", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:20.197821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] validate_networks() for [('01b7a00e-6b5a-4e1c-b9ad-35ae3b9e3f0e', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:25:20.214101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-52e33013-a66c-4889-916e-add08554490b tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f955940>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:20.304303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-52e33013-a66c-4889-916e-add08554490b tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.088346 Aug 05 14:25:20.304303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 8/11] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:20 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:21.312894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ace1d3ec-b598-4b9a-805c-16d4dd2de0cb tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f91a8b0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:21.366698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ace1d3ec-b598-4b9a-805c-16d4dd2de0cb tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.060268 Aug 05 14:25:21.367750 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 9/12] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:21 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:22.359292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:25:22.361279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:25:22.363867 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:25:22.365155 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:25:22.366103 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:25:22.380334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8659af45-bc03-41b9-b238-16fc988e0340 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f91af70>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:22.383760 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:22.384365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:22.385177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:22.386219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:22.386796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:22.387395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:22.431709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:22.453323 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for user b9d62fe4e6de4308a3a51be3e900625f and project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:22.470044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8659af45-bc03-41b9-b238-16fc988e0340 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.094592 Aug 05 14:25:22.471432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 10/13] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:22 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:22.523397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:25:22.537095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:25:22.789525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-838b191a-7513-4d6f-91c9-3ba1f520ec44 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.729983 Aug 05 14:25:22.790265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 4/14] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:25:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 14:25:22.803277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fc3feb8f-2e0c-438b-9576-eb78c0915eb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:22.803919 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fc3feb8f-2e0c-438b-9576-eb78c0915eb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:23.097520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fc3feb8f-2e0c-438b-9576-eb78c0915eb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:23.128580 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fc3feb8f-2e0c-438b-9576-eb78c0915eb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1222 microversion: 2.1 time: 0.330775 Aug 05 14:25:23.132516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 11/15] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:22 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:23.483914 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f6b047ef-e128-4825-a7ac-21b3f037cd9d tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f06c820>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:23.576608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f6b047ef-e128-4825-a7ac-21b3f037cd9d tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 288 microversion: 2.1 time: 0.097211 Aug 05 14:25:23.577557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 5/16] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:23 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:23.590730 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2f78dc48-f779-48c4-a195-256c1e556fcd tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f95dca0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:23.771962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2f78dc48-f779-48c4-a195-256c1e556fcd tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 202 len: 0 microversion: 2.1 time: 0.185023 Aug 05 14:25:23.772758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 12/17] 10.222.0.26 () {58 vars in 1254 bytes} [Fri Aug 5 14:25:23 2022] DELETE /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:25:23.783482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-452fbddb-8944-49c9-ad92-e6c1ac35668d tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f053e50>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:23.849955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-452fbddb-8944-49c9-ad92-e6c1ac35668d tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 200 len: 287 microversion: 2.1 time: 0.072628 Aug 05 14:25:23.851203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 6/18] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:23 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:24.156967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cc339632-7433-482d-ade5-f6d5d4ba2cbb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:24.159057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cc339632-7433-482d-ade5-f6d5d4ba2cbb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:24.329987 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cc339632-7433-482d-ade5-f6d5d4ba2cbb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:24.349387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cc339632-7433-482d-ade5-f6d5d4ba2cbb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1222 microversion: 2.1 time: 0.192095 Aug 05 14:25:24.350968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 13/19] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:24 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:24.862734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ea122e3d-74fd-49d5-a246-3c9781af3e8e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f91a790>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:24.910895 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1267848197", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "networks": [{"uuid": "b5f53fa5-eef4-491d-8a71-932e54b17fd8"}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:24.922812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-ea122e3d-74fd-49d5-a246-3c9781af3e8e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] HTTP exception thrown: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ea122e3d-74fd-49d5-a246-3c9781af3e8e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Request method failure captured: Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 HTTP/1.1 Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShEmsxlqdqjqyqmeM-Lb3RmSKbHHPsKOn4U4ZOqC7l4evJy4e29B7q5JLyrD97Yr46treOZpjEdxSwwMN5TdD665Cb4P23CE7d1jwHpTfH31U6Fwjc0pO1cmnlc1O6x3caErMcqsH8LgDzwcU_YHPtQLeu0Nj2xAV3NIGzvROclyUA Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:25:24.931640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4de55490e2a84e4ba145a09dd6c9a877", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: b5c7a069800d476d9df8f945120ad7ea Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '0e6c5c9a-1d02-473a-a0de-e142a11b64f7'} Aug 05 14:25:24.935428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. (HTTP 404) (Request-ID: req-7cdb9cdd-178a-47d2-a5b3-f42725b6318b) Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.936143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:25:24.937801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 14:25:24.939300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ea122e3d-74fd-49d5-a246-3c9781af3e8e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Returning 404 to user: Snapshot 0e6c5c9a-1d02-473a-a0de-e142a11b64f7 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ea122e3d-74fd-49d5-a246-3c9781af3e8e tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7" status: 404 len: 111 microversion: 2.1 time: 0.075201 Aug 05 14:25:24.942474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 14/20] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Aug 5 14:25:24 2022] GET /compute/v2.1/os-snapshots/0e6c5c9a-1d02-473a-a0de-e142a11b64f7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:25:24.944652 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9a9c9d55-910e-41d3-bff5-de3f80561383 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa76562dd30>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:25.010947 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] validate_networks() for [('b5f53fa5-eef4-491d-8a71-932e54b17fd8', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:25:25.283563 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9a9c9d55-910e-41d3-bff5-de3f80561383 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366" status: 202 len: 0 microversion: 2.1 time: 0.344718 Aug 05 14:25:25.285544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 15/21] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:25:24 2022] DELETE /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:25:25.292991 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7e589a19-c600-4d68-93b7-1b3929c9a090 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f955c10>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:25.389884 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7e589a19-c600-4d68-93b7-1b3929c9a090 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366" status: 200 len: 345 microversion: 2.1 time: 0.100907 Aug 05 14:25:25.398958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 16/22] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:25 2022] GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:25.406044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:25.406949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:25.417314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:25.418303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:25.419236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:25.420254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:25.421189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:25.421952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:25.867740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:25.919448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-33325c40-1f38-4a13-8643-93e982331ce1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1226 microversion: 2.1 time: 0.518111 Aug 05 14:25:25.922925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 17/23] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:25 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1226 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:26.419029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ce8da142-0c95-4276-901c-5881181c0f27 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: .version_select at 0x7fa75f80b4c0>, body: {"keypair": {"name": "tempest-keypair-1188781242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUs5p3szZ2EVQwh9wdNiwiEl99hZTRF5FUlKy8E6SDx0eBa7BAn65K6EGmp8fueukbvaTs2InURxNU5YFMwAe2OWNbzatrkTvogoV22bEGtmSZiIcH/MPICKC7HhYp74Q=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:26.420489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:25:26.422371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:25:26.423244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:25:26.424634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:25:26.426339 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:25:26.456305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:26.457191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:26.457627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:26.459319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:26.460788 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:26.465404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:26.517933 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Getting quotas for project 85f448f6bc5845d1b0567924c78a6162. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:26.528389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Getting quotas for user 3bbe964ead724a4da59620786b5706d8 and project 85f448f6bc5845d1b0567924c78a6162. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:26.570233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:25:26.575297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:25:26.650094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-ce8da142-0c95-4276-901c-5881181c0f27 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:26.662655 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-ce8da142-0c95-4276-901c-5881181c0f27 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for user 99dc94fff06f42c39f3750484f6d8e9d and project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:26.786777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6eb24bdb-2e91-4e1b-b48c-0d3696355d55 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514700 Aug 05 14:25:26.788725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 7/24] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:25:26.794407 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c08aa1e7-8ed6-46dd-ad93-0320a06fbc55 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f070b80>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:26.861620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-c08aa1e7-8ed6-46dd-ad93-0320a06fbc55 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] HTTP exception thrown: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c08aa1e7-8ed6-46dd-ad93-0320a06fbc55 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Request method failure captured: Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 HTTP/1.1 Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShEmsxlqdqjqyqmeM-Lb3RmSKbHHPsKOn4U4ZOqC7l4evJy4e29B7q5JLyrD97Yr46treOZpjEdxSwwMN5TdD665Cb4P23CE7d1jwHpTfH31U6Fwjc0pO1cmnlc1O6x3caErMcqsH8LgDzwcU_YHPtQLeu0Nj2xAV3NIGzvROclyUA Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:25:26.867467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4de55490e2a84e4ba145a09dd6c9a877", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: b5c7a069800d476d9df8f945120ad7ea Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '66593816-9871-41ff-a20a-3c6d7c58f366'} Aug 05 14:25:26.868545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. (HTTP 404) (Request-ID: req-54b39f02-eff2-48b5-ae6a-759145098435) Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:26.869181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:25:26.870148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 14:25:26.871133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c08aa1e7-8ed6-46dd-ad93-0320a06fbc55 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Returning 404 to user: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c08aa1e7-8ed6-46dd-ad93-0320a06fbc55 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366" status: 404 len: 109 microversion: 2.1 time: 0.079408 Aug 05 14:25:26.885403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 8/25] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:26 2022] GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:25:26.886138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-86ec789a-f9e6-412c-9949-1b8f5d984b2f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:26.886138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-86ec789a-f9e6-412c-9949-1b8f5d984b2f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:26.936571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ce8da142-0c95-4276-901c-5881181c0f27 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.009444 Aug 05 14:25:26.938070 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 18/26] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:25:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:26.943573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f1ef450b-bbfb-4202-a4ce-36362f7d2665 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75f7959d0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:27.009255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-f1ef450b-bbfb-4202-a4ce-36362f7d2665 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] HTTP exception thrown: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f1ef450b-bbfb-4202-a4ce-36362f7d2665 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Request method failure captured: Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: DELETE /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 HTTP/1.1 Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShEmsxlqdqjqyqmeM-Lb3RmSKbHHPsKOn4U4ZOqC7l4evJy4e29B7q5JLyrD97Yr46treOZpjEdxSwwMN5TdD665Cb4P23CE7d1jwHpTfH31U6Fwjc0pO1cmnlc1O6x3caErMcqsH8LgDzwcU_YHPtQLeu0Nj2xAV3NIGzvROclyUA Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:25:27.011993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4de55490e2a84e4ba145a09dd6c9a877", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: b5c7a069800d476d9df8f945120ad7ea Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '66593816-9871-41ff-a20a-3c6d7c58f366'} Aug 05 14:25:27.013329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. (HTTP 404) (Request-ID: req-ed4ca11c-b6a6-443f-8eb8-16b4a402265b) Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:27.013999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 14:25:27.014925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 14:25:27.015895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.018540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.021001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f1ef450b-bbfb-4202-a4ce-36362f7d2665 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Returning 404 to user: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:25:27.022091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f1ef450b-bbfb-4202-a4ce-36362f7d2665 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366" status: 404 len: 109 microversion: 2.1 time: 0.082858 Aug 05 14:25:27.022726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 19/27] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:25:26 2022] DELETE /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:25:27.030226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:27.042422 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:27.069384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:27.074217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:27.078473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:27.079381 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:27.079875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:27.087475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:27.344485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-86ec789a-f9e6-412c-9949-1b8f5d984b2f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:27.382069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:27.397253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-86ec789a-f9e6-412c-9949-1b8f5d984b2f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1215 microversion: 2.1 time: 0.526407 Aug 05 14:25:27.420742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 9/28] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:26 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1215 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:27.421299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0f001411-5e6d-443a-bc4c-3f21cad75906 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1282 microversion: 2.1 time: 0.396218 Aug 05 14:25:27.422871 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 20/29] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:27 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1282 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:27.425482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ce4a1c36-05ab-4d4f-ad34-42e52f549ff9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Calling method '.version_select at 0x7fa75e7e9790>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:27.494223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-ce4a1c36-05ab-4d4f-ad34-42e52f549ff9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] HTTP exception thrown: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ce4a1c36-05ab-4d4f-ad34-42e52f549ff9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Request method failure captured: Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 HTTP/1.1 Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShEmsxlqdqjqyqmeM-Lb3RmSKbHHPsKOn4U4ZOqC7l4evJy4e29B7q5JLyrD97Yr46treOZpjEdxSwwMN5TdD665Cb4P23CE7d1jwHpTfH31U6Fwjc0pO1cmnlc1O6x3caErMcqsH8LgDzwcU_YHPtQLeu0Nj2xAV3NIGzvROclyUA Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:25:27.496610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4de55490e2a84e4ba145a09dd6c9a877", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4de55490e2a84e4ba145a09dd6c9a877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 4de55490e2a84e4ba145a09dd6c9a877 Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-906753876 Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: b5c7a069800d476d9df8f945120ad7ea Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesSnapshotsTestJSON-906753876-project Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '66593816-9871-41ff-a20a-3c6d7c58f366'} Aug 05 14:25:27.497672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. (HTTP 404) (Request-ID: req-a7426b7a-68ac-46dc-b360-9f8600df4f22) Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:27.498488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:25:27.499399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 14:25:27.500291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ce4a1c36-05ab-4d4f-ad34-42e52f549ff9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] Returning 404 to user: Volume 66593816-9871-41ff-a20a-3c6d7c58f366 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:25:27.501247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ce4a1c36-05ab-4d4f-ad34-42e52f549ff9 tempest-VolumesSnapshotsTestJSON-906753876 tempest-VolumesSnapshotsTestJSON-906753876-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366" status: 404 len: 109 microversion: 2.1 time: 0.086488 Aug 05 14:25:27.503185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 10/30] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:27 2022] GET /compute/v2.1/os-volumes/66593816-9871-41ff-a20a-3c6d7c58f366 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:25:28.191640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-084c6cdb-7265-4855-994f-c069126bf7d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'create', calling method: .version_select at 0x7fa75ef605e0>, body: {"keypair": {"name": "tempest-keypair-1630565701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXdwQyAqtqZGPcd4wi0jlSFl3cnEfz7htfvxze13IgvncRncvvYXZ7tU9XWjgVugMfyaQJdVoON7sPMqeWEhOrQ5b6ZcPoq5H8nfncsaKmpxoQ2Lu9s1wwC6UqTTe7L4A=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:28.262215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-084c6cdb-7265-4855-994f-c069126bf7d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for project 5c13896c64e44b60838d3f313407433f. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:28.269758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-084c6cdb-7265-4855-994f-c069126bf7d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for user 084b18670c2a4c1396d5912d130b2bac and project 5c13896c64e44b60838d3f313407433f. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:28.385128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-084c6cdb-7265-4855-994f-c069126bf7d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.959001 Aug 05 14:25:28.389544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 21/31] 10.222.0.26 () {62 vars in 1200 bytes} [Fri Aug 5 14:25:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 965 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 14:25:28.432726 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-74e713fe-42fe-4625-978f-192b57da66ca tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:28.433347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-74e713fe-42fe-4625-978f-192b57da66ca tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:28.448144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:28.449142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:28.482300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:28.482985 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:28.483448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:28.488142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:28.492907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:28.494473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:29.148320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:29.194039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d3b37853-a9ad-4a9e-8ea1-fcb97a3eaea5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1280 microversion: 2.1 time: 0.748546 Aug 05 14:25:29.211506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 22/32] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:28 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1280 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:29.252687 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-74e713fe-42fe-4625-978f-192b57da66ca tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:29.274429 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-74e713fe-42fe-4625-978f-192b57da66ca tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1215 microversion: 2.1 time: 0.836820 Aug 05 14:25:29.277356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 11/33] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:28 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1215 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:30.237307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:30.237307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:30.237307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:30.237307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:30.238251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:30.239834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:30.240324 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:30.240827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:30.300745 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:30.317811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:30.317811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:30.317811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:30.317811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:30.318704 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:30.322599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:30.324626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:30.559468 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:30.594982 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eb0c3e8c-28fc-4c0c-9462-cec129727b98 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1280 microversion: 2.1 time: 0.376855 Aug 05 14:25:30.626935 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 23/34] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:30 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:30.803842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:30.855068 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2dc50e20-8f45-47d2-8044-d98ed69f3e58 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1267 microversion: 2.1 time: 0.559048 Aug 05 14:25:30.861105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 12/35] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:30 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1267 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:31.622814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:31.625271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:31.637573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:31.640347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:31.644154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:31.644154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:31.645997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:31.649004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:31.798001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:31.816327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-165ed10f-f5d1-41de-9a48-4db86989b209 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1280 microversion: 2.1 time: 0.198142 Aug 05 14:25:31.826925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 24/36] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:31 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:31.884036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:31.884820 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:31.912649 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:31.914526 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:31.915896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:31.922756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:31.924186 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:31.927650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:32.095573 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:32.118606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-82dd096b-2b7f-4b7f-bda4-3bf1d6c165a5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1273 microversion: 2.1 time: 0.239244 Aug 05 14:25:32.120395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 13/37] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:31 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:32.839676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:32.845720 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:32.865714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:32.865714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:32.865714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:32.866645 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:32.867547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:32.869429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:33.147459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:33.148963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:33.166503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:33.172621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:33.173327 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:33.178638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:33.179680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:33.180987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:33.401407 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:33.411948 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d6787c6a-5e72-4d43-b73e-e1510ff6dc15 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1273 microversion: 2.1 time: 0.269810 Aug 05 14:25:33.431858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 14/38] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:33 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:33.438182 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:33.463047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ed840e6a-d0e7-4d92-802f-a0268f8a68d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.610959 Aug 05 14:25:33.463047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 25/39] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:32 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:34.448619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:34.450133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:34.471328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:34.471820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:34.482554 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:34.483614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:34.484590 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:34.485636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:34.486584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:34.487158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:34.491850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:34.496542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:34.496542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:34.496542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:34.496542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:34.496931 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:34.680478 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:34.694364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-409d1b36-41f8-4628-ae91-813d44f7cb2b tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1273 microversion: 2.1 time: 0.245080 Aug 05 14:25:34.695873 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 15/40] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:34 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:35.047199 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:35.073881 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c0749aac-db97-4147-944a-29cb92a9d466 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.607787 Aug 05 14:25:35.076393 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 26/41] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:34 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:35.720882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:35.722100 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:35.750922 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:35.751999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:35.753711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:35.755533 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:35.756181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:35.756804 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.109297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:36.111441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:36.121034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:36.121543 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:36.122021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.122742 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:36.123200 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:36.123633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.234898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:36.257060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1f195572-27de-466a-a587-40ef6044f8b2 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1273 microversion: 2.1 time: 0.538396 Aug 05 14:25:36.273963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 16/42] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:35 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1273 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:36.422524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ecbb29-5d49-412c-8436-189fb1a14079", "tag": "3334ae2f-5b07-4c8f-9969-546288fe7c42"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:36.459030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:36.459840 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:36.460567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.486179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Creating event network-changed:3334ae2f-5b07-4c8f-9969-546288fe7c42 for instance 93ecbb29-5d49-412c-8436-189fb1a14079 on hv-cinder-80295 Aug 05 14:25:36.487070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 14:25:36.488004 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-1cba5dad-73ee-4ca3-ba95-f304b0758dcb req-fd7c5680-e677-4348-9bf1-4218a67ee044 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 14:25:36.489680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:36.490427 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:36.491099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.495818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:36.495818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:36.495818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.503194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:36.505492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.compute.rpcapi [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 14:25:36.506768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] Releasing lock "compute-rpcapi-router" {{(pid=118052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 14:25:36.539513 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-46d3448c-05db-45b3-876a-7bb9017b23db None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233994 Aug 05 14:25:36.541320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 17/43] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:36.619309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:36.656843 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-653da97e-3e7a-4fc8-b28a-3d4d2400f74c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.560571 Aug 05 14:25:36.659848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 27/44] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:36 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:36.873715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-8132c848-7714-4b46-ba46-1ac67e569705 req-2042b619-69dd-4ebd-9d5c-6914d512a4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145b6612-d562-4fb1-8ef7-35259df1cf19", "tag": "5d11bb3d-e647-4217-aeeb-63b14f3f279a"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:36.886565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-8132c848-7714-4b46-ba46-1ac67e569705 req-2042b619-69dd-4ebd-9d5c-6914d512a4e1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:36.887284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-8132c848-7714-4b46-ba46-1ac67e569705 req-2042b619-69dd-4ebd-9d5c-6914d512a4e1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:36.887903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-8132c848-7714-4b46-ba46-1ac67e569705 req-2042b619-69dd-4ebd-9d5c-6914d512a4e1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:36.909833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-8132c848-7714-4b46-ba46-1ac67e569705 req-2042b619-69dd-4ebd-9d5c-6914d512a4e1 service nova] Creating event network-changed:5d11bb3d-e647-4217-aeeb-63b14f3f279a for instance 145b6612-d562-4fb1-8ef7-35259df1cf19 on hv-cinder-80295 Aug 05 14:25:36.916206 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-8132c848-7714-4b46-ba46-1ac67e569705 req-2042b619-69dd-4ebd-9d5c-6914d512a4e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148492 Aug 05 14:25:36.917528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 18/45] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:37.047798 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1400950338", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "275d8efb-e4f4-42a1-a3d7-242f88553872"}], "security_groups": [{"name": "tempest-securitygroup--189321154"}], "key_name": "tempest-keypair-1188781242", "user_data": "}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:37.269321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] validate_networks() for [('275d8efb-e4f4-42a1-a3d7-242f88553872', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:25:37.279669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:37.280382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:37.288315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:37.288838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:37.289317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:37.290713 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:37.291621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:37.291969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:37.588238 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:37.598917 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1a47b002-eba9-4337-b404-777c78dfee31 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.323345 Aug 05 14:25:37.599501 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 19/46] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:37 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:37.680019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:37.680670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:37.686905 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:37.687401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:37.687845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:37.688572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:37.689030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:37.689454 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:37.893690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:37.902928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-afeed4ad-efb8-4bf4-90e3-5ba1415be1c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.227254 Aug 05 14:25:37.903072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 20/47] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:37 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:38.043516 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1439789880", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f6048a0-a883-4ba7-8de3-615ae195e1ec"}], "security_groups": [{"name": "tempest-securitygroup--303800576"}], "key_name": "tempest-keypair-1630565701", "user_data": "}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:38.152614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:25:38.158981 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:25:38.161287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:25:38.169957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:25:38.169957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:25:38.173094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] validate_networks() for [('6f6048a0-a883-4ba7-8de3-615ae195e1ec', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:25:38.190772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.191514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.192883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.198770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.198770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.198770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.221109 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:38.226291 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for user 99dc94fff06f42c39f3750484f6d8e9d and project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:38.240771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:25:38.243955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:25:38.398993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-522a9fe4-9ef4-46f2-8850-8d9e1932670e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.352988 Aug 05 14:25:38.398993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 28/48] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:25:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:25:38.414827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5d2d2bcd-9f7b-4952-a7b8-4a5f2f85de0e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:38.415654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5d2d2bcd-9f7b-4952-a7b8-4a5f2f85de0e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:38.508056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5d2d2bcd-9f7b-4952-a7b8-4a5f2f85de0e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:38.518486 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5d2d2bcd-9f7b-4952-a7b8-4a5f2f85de0e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1238 microversion: 2.1 time: 0.113847 Aug 05 14:25:38.519358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 29/49] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:38 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:38.619708 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:38.620319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:38.626549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.627040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.627493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.628272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.628904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.629384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.822000 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:25:38.822641 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:25:38.823116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:25:38.824284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:25:38.824738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:25:38.835134 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:38.835661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.837089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.837089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.837369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.837933 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.838528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.844322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7ed6c3fb-d2e6-4c16-a2ab-08eff7908950 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.228322 Aug 05 14:25:38.845325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 30/50] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:38 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:38.857492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for project 5c13896c64e44b60838d3f313407433f. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:25:38.862348 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for user 084b18670c2a4c1396d5912d130b2bac and project 5c13896c64e44b60838d3f313407433f. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:25:38.875029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:25:38.877525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:25:38.922947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:38.923938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:38.931939 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.932703 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.933464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:38.936113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:38.936113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:38.936113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:39.063272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-58b83a83-a88c-4180-bb20-c160909be731 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.024180 Aug 05 14:25:39.064091 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 21/51] 10.222.0.26 () {62 vars in 1188 bytes} [Fri Aug 5 14:25:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 05 14:25:39.077076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8a2e83c5-fe9a-4d45-8608-3ce2dba95092 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:39.077689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8a2e83c5-fe9a-4d45-8608-3ce2dba95092 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:39.085094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:39.098354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6e3b6054-2000-438c-ab15-76ea6558569d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.178560 Aug 05 14:25:39.109407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 31/52] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:38 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:39.137052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8a2e83c5-fe9a-4d45-8608-3ce2dba95092 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:39.144760 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8a2e83c5-fe9a-4d45-8608-3ce2dba95092 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:39.146301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8a2e83c5-fe9a-4d45-8608-3ce2dba95092 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:39.147406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8a2e83c5-fe9a-4d45-8608-3ce2dba95092 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1282 microversion: 2.20 time: 0.076454 Aug 05 14:25:39.148283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 22/53] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:39 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:25:39.540218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-533ac981-4812-4c6b-ae66-54a85920e7b9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:39.540986 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-533ac981-4812-4c6b-ae66-54a85920e7b9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:39.543425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:39.598764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-533ac981-4812-4c6b-ae66-54a85920e7b9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:39.605890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-533ac981-4812-4c6b-ae66-54a85920e7b9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1238 microversion: 2.1 time: 0.070101 Aug 05 14:25:39.606473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 32/54] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:39 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:39.871729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:39.872911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:39.883937 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:39.885221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:39.885221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:39.897017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:39.897551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:39.898013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:40.125586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:40.126318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:40.156378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:40.158749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:40.159325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:40.161412 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:40.163004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:40.163634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:40.165796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:40.174765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b90f708d-e0f1-4059-a61a-fa1fea2e2561 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.309353 Aug 05 14:25:40.175448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 23/55] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:39 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:40.185231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-36840fc0-38a1-409a-806b-5f6be64f83e1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:40.188798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-36840fc0-38a1-409a-806b-5f6be64f83e1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:40.195477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:40.283902 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-36840fc0-38a1-409a-806b-5f6be64f83e1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:40.313343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-36840fc0-38a1-409a-806b-5f6be64f83e1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:40.318169 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-36840fc0-38a1-409a-806b-5f6be64f83e1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:40.329628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-36840fc0-38a1-409a-806b-5f6be64f83e1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1282 microversion: 2.20 time: 0.152575 Aug 05 14:25:40.345211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 24/56] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:40 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:40.399407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:40.423205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-107e95d4-1b0c-4f09-8228-7dac7b666489 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.296856 Aug 05 14:25:40.423205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 33/57] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:40 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:40.627457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:40.636615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:40.643675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:40.644774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:40.648727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:40.648727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:40.648727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:40.648727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:40.719091 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:40.727570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8054bd48-74f3-44d7-bb90-8bd34eebb2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1242 microversion: 2.1 time: 0.104261 Aug 05 14:25:40.728150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 25/58] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:40 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:41.202595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:41.203208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:41.212109 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.212707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.213524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.214560 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.215270 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.216113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.354410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:41.356105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:41.363486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.364273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.364740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.365476 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.366074 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.366502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.366702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:41.374775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ba787723-1cc2-48bb-9977-77c27a009d5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.177598 Aug 05 14:25:41.389727 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 34/59] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:41 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:41.432989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:41.441607 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:41.443321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:41.444831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-57fe72fb-5087-4801-829b-ac6f4c9d5895 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1286 microversion: 2.20 time: 0.094314 Aug 05 14:25:41.445882 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:41.446710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:41.449913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 26/60] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:41 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:25:41.458597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.458597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.458597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.458597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.458889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.458889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.750129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:41.751036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:41.764671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.765333 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.765974 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.767629 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:41.768336 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:41.769536 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:41.802175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:41.810348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3ca99c4b-7636-4a2e-9051-3f4f60d0aba5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.370427 Aug 05 14:25:41.810921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 35/61] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:41 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:41.898036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:41.906536 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-69b55bc2-86bc-4caf-8e62-f7f87b54bd8f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1242 microversion: 2.1 time: 0.160735 Aug 05 14:25:41.912910 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 27/62] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:41 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:42.121751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a569e75b-6393-402e-b7d6-d24f146bf327 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75ef790d0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:42.173910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a569e75b-6393-402e-b7d6-d24f146bf327 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ee2baad-3479-4cbf-afeb-cc64d6cb39fb" status: 200 len: 351 microversion: 2.1 time: 0.056093 Aug 05 14:25:42.174493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 36/63] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:42 2022] GET /compute/v2.1/os-volumes/1ee2baad-3479-4cbf-afeb-cc64d6cb39fb => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:42.399371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:42.400730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:42.407033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.407786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.408372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.409313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.409973 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.410656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.467399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:42.469970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:42.478227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.478809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.479318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.480017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.480714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.481320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.560400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:42.569469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:42.571314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:42.572835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b5d6ae61-4d0e-4596-a80f-18a4e175687f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1286 microversion: 2.20 time: 0.109877 Aug 05 14:25:42.573898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 37/64] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:42 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:25:42.602784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:42.615740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7883749c-0f45-4d49-a388-0a675dc3ddab tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.217209 Aug 05 14:25:42.615740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 28/65] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:42 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:42.831956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:42.833354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:42.840774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.841481 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.842209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.843371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.843997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.844602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.940013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:42.940831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:42.948764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.950542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.952260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:42.953668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:42.956020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:42.958472 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:43.055545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:43.063761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eab5f5a1-9e8e-498e-bf09-5f76edd02dac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.236198 Aug 05 14:25:43.064335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 38/66] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:42 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:43.073691 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:43.083617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d02ce0a4-59e7-4bcb-9880-b4d72897ee86 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1242 microversion: 2.1 time: 0.158858 Aug 05 14:25:43.084575 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 29/67] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:42 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:43.595469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:43.595992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:43.602181 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:43.602662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:43.603102 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:43.603790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:43.604242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:43.604693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:43.633190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:43.634936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:43.641008 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:43.641487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:43.641934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:43.642651 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:43.643099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:43.643633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:43.667669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:43.676928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:43.678721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:43.680030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0328d018-6b79-44b5-ac3f-4315898dda2e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1286 microversion: 2.20 time: 0.088780 Aug 05 14:25:43.680616 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 39/68] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:43 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:43.814516 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:43.827252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8cbad63f-9e1c-4814-8aea-0e42394b5bbf tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.198520 Aug 05 14:25:43.828521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 30/69] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:43 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:44.084959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:44.085779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:44.091851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.092335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.093066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.093751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.094199 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.094634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.100635 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:44.109571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:44.109571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:44.114427 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.115336 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.115813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.116636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.117242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.117750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.123040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:44.205223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:44.216861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b3884bb3-8941-44fc-a321-84ca30777064 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1242 microversion: 2.1 time: 0.113453 Aug 05 14:25:44.218471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 31/70] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:44 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:44.290667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:44.298858 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-efabe01f-4069-4645-92ef-17259d90ff09 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.218399 Aug 05 14:25:44.299480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 40/71] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:44 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:44.703185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:44.703798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:44.711461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.711962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.712402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.713123 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.713577 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.714004 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.774567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:44.782402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:44.783916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:44.785056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-76b5d089-bfb5-4b1d-bea4-337f466cd9f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1286 microversion: 2.20 time: 0.085825 Aug 05 14:25:44.786199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 32/72] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:44 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:44.847475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:44.848692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:44.854712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.855198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.855639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.856331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:44.856816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:44.857264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:44.944852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1b6a1d7f-ab01-42ec-938e-62969172f932 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75e723430>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:44.997765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1b6a1d7f-ab01-42ec-938e-62969172f932 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6284936f-65e8-4d00-a971-958edf0d8bf0" status: 200 len: 350 microversion: 2.1 time: 0.051729 Aug 05 14:25:44.997765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 33/73] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:44 2022] GET /compute/v2.1/os-volumes/6284936f-65e8-4d00-a971-958edf0d8bf0 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:45.008646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:45.016107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d2407f76-d930-4e19-a641-d6e318fa17d8 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.172446 Aug 05 14:25:45.016895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 41/74] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:44 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:45.239335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:45.240063 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:45.246035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:45.246536 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:45.246975 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:45.247734 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:45.248188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:45.248643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:45.313187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:45.321353 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-844daed7-bd65-4124-9b57-281222aaea04 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1242 microversion: 2.1 time: 0.086060 Aug 05 14:25:45.321925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 34/75] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:45 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:45.322475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:45.323154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:45.329363 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:45.330057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:45.330496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:45.331450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:45.332592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:45.333575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:45.467098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:45.475787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7441e967-da5f-43b2-a771-ff4da2374327 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.157184 Aug 05 14:25:45.476619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 42/76] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:45 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:45.807430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:45.808096 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:45.814618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:45.819392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:45.819392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:45.819392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:45.819392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:45.819934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:45.905188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:45.915356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:45.917156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:45.918321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-146d9450-e378-4ccc-a674-9f7267ab6531 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1286 microversion: 2.20 time: 0.115156 Aug 05 14:25:45.918838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 35/77] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:45 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:46.038536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:46.039229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:46.049992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.050755 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.051765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.054017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.054856 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.055928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.343364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:46.344249 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:46.350705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.355200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.355200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.355200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.355200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.355567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.371156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:46.383735 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e3a5a457-ce27-4ae0-a0c3-1caf32be56c1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.350397 Aug 05 14:25:46.385067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 43/78] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:46 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:46.431769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:46.439941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b0c2aa14-cc66-4faa-b3f6-e06e39252bd1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1234 microversion: 2.1 time: 0.100405 Aug 05 14:25:46.441160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 36/79] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:46 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:46.496379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:46.497120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:46.505003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.505493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.506071 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.508921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.508921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.508921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.831575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:46.839833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3eefe1da-381a-418a-b9e3-5d188c487e50 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.347245 Aug 05 14:25:46.840405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 44/80] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:46 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:46.946653 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:46.947279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:46.954507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.955027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.955652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:46.956550 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:46.957671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:46.958109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.001385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38be03aa-2408-4b4e-a390-cf61d00b5e9e", "tag": "8c88e5b0-19b1-4814-8072-21e730bd6899"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:47.022161 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.022654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.023396 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.045079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:47.045331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Creating event network-changed:8c88e5b0-19b1-4814-8072-21e730bd6899 for instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e on hv-cinder-80295 Aug 05 14:25:47.045853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118053) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 14:25:47.046221 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2dd8f744-4d60-444c-b8c5-3d764c6b66cd req-d816274a-12d1-47da-9e08-ad64f481d291 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118053) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 14:25:47.047249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.047714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.048142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.048883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.049340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.049768 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.053723 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:47.055321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:47.056439 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2f814f5a-0670-490e-9ce8-9239077b2288 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1334 microversion: 2.20 time: 0.115073 Aug 05 14:25:47.058810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.compute.rpcapi [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 14:25:47.059690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] Releasing lock "compute-rpcapi-router" {{(pid=118053) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 14:25:47.071755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 37/81] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:46 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1334 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:47.076846 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-30ceafc9-fe51-4935-be77-50579577dac0 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079034 Aug 05 14:25:47.077612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 45/82] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:47.405825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:47.406436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:47.413167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.414045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.414738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.415941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.416627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.417199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.468398 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:47.469504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:47.479709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.491600 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.492292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.493222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.493850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.494282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.859378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:47.868093 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-185525f0-9b37-4e45-9f16-09463095f350 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1298 microversion: 2.1 time: 0.405954 Aug 05 14:25:47.883519 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 46/83] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:47 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1298 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:47.889800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8174c112-00f6-4999-9101-09164416960e tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75ef32dc0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:47.951640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8174c112-00f6-4999-9101-09164416960e tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72ff0dfa-1ea1-4008-99e9-302a271225d4" status: 200 len: 350 microversion: 2.1 time: 0.066716 Aug 05 14:25:47.952214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 47/84] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:25:47 2022] GET /compute/v2.1/os-volumes/72ff0dfa-1ea1-4008-99e9-302a271225d4 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:47.966440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:47.969799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:47.981526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.982085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.982517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:47.983157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:47.983619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:47.984051 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:48.200067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:48.211019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-db1e4c85-4a87-43b0-a35a-dfc2cec06c50 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.809291 Aug 05 14:25:48.211905 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 38/85] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:47 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:48.217210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f3961b89-9056-4627-91b8-82c38fd02380 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75e76b5e0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:48.351046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:48.368746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8ef021b6-feb6-4ce2-ac00-b30bbef4f8bd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.406650 Aug 05 14:25:48.369401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 48/86] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:47 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:48.376496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:48.377294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:48.394227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:48.395042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:48.395715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:48.396624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:48.397252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:48.397831 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:48.542731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f3961b89-9056-4627-91b8-82c38fd02380 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.329377 Aug 05 14:25:48.543327 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 39/87] 10.222.0.26 () {58 vars in 1134 bytes} [Fri Aug 5 14:25:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:48.557292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d34249b4-31b7-437e-a636-b9294fd243c5 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75e6ebf70>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:48.723213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:48.733690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d34249b4-31b7-437e-a636-b9294fd243c5 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180201 Aug 05 14:25:48.744494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:48.744494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:48.744494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a77084c9-2b36-4913-85ca-f618fd2268f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1340 microversion: 2.20 time: 0.367116 Aug 05 14:25:48.745580 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 49/88] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:48 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1340 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:48.749909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 40/89] 10.222.0.26 () {58 vars in 1149 bytes} [Fri Aug 5 14:25:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:48.755147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5b1c3855-2bd6-40ac-a9c3-d4f8f2aebf0f tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75eeb7790>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:48.878788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5b1c3855-2bd6-40ac-a9c3-d4f8f2aebf0f tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.132365 Aug 05 14:25:48.879644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 50/90] 10.222.0.26 () {58 vars in 1134 bytes} [Fri Aug 5 14:25:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:48.889094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=4 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:48.893635 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:48.893783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:48.894086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-df6be3af-15a3-436e-bfb4-ac2175029dd2 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75e6b6d30>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:48.917459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:48.917980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:48.918434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:48.919142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:48.919885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:48.920487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:48.995186 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-df6be3af-15a3-436e-bfb4-ac2175029dd2 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.106855 Aug 05 14:25:48.995847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 41/91] 10.222.0.26 () {58 vars in 1167 bytes} [Fri Aug 5 14:25:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:49.009359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2bd99d27-82f1-4b99-bbb6-0899c0735c25 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75f078ca0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.063761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:49.071770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-03c98aea-6339-46d9-a08e-782f7d543c72 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1296 microversion: 2.1 time: 0.182659 Aug 05 14:25:49.073034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 51/92] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:48 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:49.118997 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2bd99d27-82f1-4b99-bbb6-0899c0735c25 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.113494 Aug 05 14:25:49.121768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 42/93] 10.222.0.26 () {58 vars in 1170 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:49.134059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-79b84fa4-6918-461d-8b18-f62f83f0c7c3 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75eea2670>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.227295 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-79b84fa4-6918-461d-8b18-f62f83f0c7c3 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096829 Aug 05 14:25:49.228870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 52/94] 10.222.0.26 () {58 vars in 1155 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:49.243252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4c830771-44bb-40dd-8cd1-20fd1d432ffa tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75e6eb790>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.253230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.255404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:49.264780 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:49.265476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:49.266077 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:49.266915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:49.267509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:49.268096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:49.400335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4c830771-44bb-40dd-8cd1-20fd1d432ffa tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.161782 Aug 05 14:25:49.414630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 43/95] 10.222.0.26 () {58 vars in 1188 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:49.436940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.436940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:49.439564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:49.440213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:49.440902 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:49.442538 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:49.443354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:49.444274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:49.512393 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:49.535741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-232f9e04-baad-4733-8778-d9f62cf61ec9 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.285504 Aug 05 14:25:49.536394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 53/96] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:49.551989 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4494d91b-50a2-4195-b5dc-ac984e56c0b5 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] Calling method '.version_select at 0x7fa75eea2d30>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.602380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=24 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:49.652265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4494d91b-50a2-4195-b5dc-ac984e56c0b5 tempest-VolumesTestJSON-1066884963 tempest-VolumesTestJSON-1066884963-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.114468 Aug 05 14:25:49.653263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 54/97] 10.222.0.26 () {58 vars in 1155 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:49.668864 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:49.933968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-eeefea15-dba4-4ab6-a81f-18a7e9c104d5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.266326 Aug 05 14:25:49.933968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 44/98] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:49.935235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:49.935235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:49.935235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:49.935235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:49.936073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:49.936073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:49.936073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:49.936073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:49.936991 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:49.938343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:49.939902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:49.941944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-867c90e0-7e50-48d8-8df5-52a9a03827ac tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.182961 Aug 05 14:25:49.942767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 55/99] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:49 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:50.106596 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:50.107230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:50.114061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.114555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.114993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.115696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.116152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.116613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.187923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:50.196574 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-289699cf-02cd-43a0-b236-b5e7e0640ded tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1296 microversion: 2.1 time: 0.098866 Aug 05 14:25:50.197178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 45/100] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:50 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:50.557896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:50.558576 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:50.564741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.565256 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.565687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.566379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.566831 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.567253 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.716193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:50.727091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-faa932d9-703d-4254-8561-4942b970bdf5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.172699 Aug 05 14:25:50.728258 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 56/101] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:50 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:50.934499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:50.934990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:50.941361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=32 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:50.944029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.944728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.945350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.946056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.946522 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.946968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.965807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:50.970536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:50.982167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.982786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.983621 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:50.984354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:50.984897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:50.985330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:51.205006 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:51.214200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-35169857-2a61-4ca6-bfcb-bae7a7a98e1f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.286331 Aug 05 14:25:51.215246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 46/102] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:50 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:51.223309 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:51.224349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:51.230933 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:51.231425 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:51.231862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:51.232645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:51.233166 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:51.233635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:51.236156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:51.244736 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:51.246406 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:51.247523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-65cb4011-60aa-450f-9777-81c893cdcc24 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.286110 Aug 05 14:25:51.248397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 57/103] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:50 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:51.389378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:51.397725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a4918bfe-f335-4411-900b-9dce359b5e1b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.181309 Aug 05 14:25:51.398295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 47/104] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:51 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:51.749673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:51.750889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:51.757680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:51.758334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:51.758966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:51.759825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:51.760439 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:51.761019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:51.919346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:51.931226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-82efa66f-fab2-4524-a0f6-3cd7557151f1 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.185198 Aug 05 14:25:51.932085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 58/105] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:51 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:52.236354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:52.236997 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:52.244128 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.246645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.246645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.246645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.246645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.247202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.272356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:52.274176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:52.282399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.283133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.283639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.284407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.285040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.285689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.491404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:52.499294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9e485d38-bac0-402d-9d36-7cac6fa61ef0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.266810 Aug 05 14:25:52.500038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 48/106] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:52 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:52.505225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:52.505834 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:52.511509 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.511999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.512458 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.512623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:52.513158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.513616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.514042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.524928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:52.528543 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:52.529957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0da96d87-9bbf-4109-86c3-1fee05ca6c17 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.263598 Aug 05 14:25:52.530694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 59/107] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:52 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:52.680318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:52.688736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6e9374d4-1c17-48e8-9df8-e8884cfc2619 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.186999 Aug 05 14:25:52.689766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 49/108] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:52 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:52.951275 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:52.951906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:52.959178 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.959889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.960637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:52.961383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:52.961849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:52.962283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:53.108821 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:53.131261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-702f78da-e3c1-4dae-a9fd-f6765fbbb9b7 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.183675 Aug 05 14:25:53.144960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 60/109] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:52 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:53.521363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:53.521992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:53.533889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:53.536010 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:53.545951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:53.545951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:53.545951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:53.545951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:53.557995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:53.558654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:53.571829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:53.572455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:53.575852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:53.582287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:53.586649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:53.587422 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:53.607466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:53.892565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:53.915688 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:53.928976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:53.937454 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:53.940382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-91e766b7-a93b-44da-8566-262b0a0a26a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.385425 Aug 05 14:25:53.945566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 61/110] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:53 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:25:53.949347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-067e73b7-0af7-4e61-86d6-7a4174269067 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.432471 Aug 05 14:25:53.950190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 50/111] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:53 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:53.957272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:53.958498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:53.968014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:53.968014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:53.968260 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:53.969377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:53.971341 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:53.971987 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.151364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:54.151979 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:54.152992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:54.158628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.159204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.159651 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.161051 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.161499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.161927 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.162289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b18a8d0a-efe0-43c0-8ad1-ff2dace5eb7a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.215260 Aug 05 14:25:54.169977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 62/112] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:53 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:54.324816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-c90dfbcc-bd86-4c17-9520-1b301ac9943e req-aea28a67-b5f0-4d6c-bb99-8d37e5946d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:54.346282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-c90dfbcc-bd86-4c17-9520-1b301ac9943e req-aea28a67-b5f0-4d6c-bb99-8d37e5946d56 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.346778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-c90dfbcc-bd86-4c17-9520-1b301ac9943e req-aea28a67-b5f0-4d6c-bb99-8d37e5946d56 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.347789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-c90dfbcc-bd86-4c17-9520-1b301ac9943e req-aea28a67-b5f0-4d6c-bb99-8d37e5946d56 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.390530 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-c90dfbcc-bd86-4c17-9520-1b301ac9943e req-aea28a67-b5f0-4d6c-bb99-8d37e5946d56 service nova] Creating event network-changed:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:25:54.397333 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-c90dfbcc-bd86-4c17-9520-1b301ac9943e req-aea28a67-b5f0-4d6c-bb99-8d37e5946d56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084250 Aug 05 14:25:54.398687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 63/113] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:54.536075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-f3162fd7-3267-4585-ae7a-e7d4780e7ee7 req-b1324498-3160-4f2a-8d50-b0c40bc97860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a17e392-41cb-4261-94a6-5f144eefe190", "tag": "d2c9fb6e-8b73-4b73-b212-e026732f6ed6"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:54.565120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f3162fd7-3267-4585-ae7a-e7d4780e7ee7 req-b1324498-3160-4f2a-8d50-b0c40bc97860 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.565981 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f3162fd7-3267-4585-ae7a-e7d4780e7ee7 req-b1324498-3160-4f2a-8d50-b0c40bc97860 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.567333 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f3162fd7-3267-4585-ae7a-e7d4780e7ee7 req-b1324498-3160-4f2a-8d50-b0c40bc97860 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.587748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-f3162fd7-3267-4585-ae7a-e7d4780e7ee7 req-b1324498-3160-4f2a-8d50-b0c40bc97860 service nova] Creating event network-changed:d2c9fb6e-8b73-4b73-b212-e026732f6ed6 for instance 0a17e392-41cb-4261-94a6-5f144eefe190 on hv-cinder-80295 Aug 05 14:25:54.600488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-f3162fd7-3267-4585-ae7a-e7d4780e7ee7 req-b1324498-3160-4f2a-8d50-b0c40bc97860 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069296 Aug 05 14:25:54.601520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 64/114] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:25:54.683726 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:54.691601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8267adaf-61a3-4fdb-95cd-06f2aa997eb3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.544044 Aug 05 14:25:54.692125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 51/115] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:54 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:25:54.967527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:54.968246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:54.971541 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:54.972265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:54.974593 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.975054 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.975486 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.977008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.977483 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.977978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.979411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.979978 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.980530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:54.981419 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:54.982146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:54.982587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:55.184329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:55.202578 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:55.205744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:55.207701 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:55.213849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-dfd62134-4042-4d48-8548-6c4374e70b21 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.247713 Aug 05 14:25:55.213849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 65/116] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:54 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:55.217854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:55.218724 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:55.224182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-adc6182c-8494-48a9-b51d-095b217e4f3c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.257417 Aug 05 14:25:55.227525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 52/117] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:54 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:55.233698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:55.234959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:55.235604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:55.236516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:55.238694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:55.239806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:55.419683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:55.428304 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-27986a5c-62cb-49d1-b15a-002b4447096d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.215667 Aug 05 14:25:55.429008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 66/118] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:55 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:55.529292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-02321081-410a-4076-9437-5a241bb6849f req-1ceee697-be3a-4a8b-a35b-f9a1355ce549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ecbb29-5d49-412c-8436-189fb1a14079", "name": "network-vif-plugged", "status": "completed", "tag": "3334ae2f-5b07-4c8f-9969-546288fe7c42"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:55.541029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-02321081-410a-4076-9437-5a241bb6849f req-1ceee697-be3a-4a8b-a35b-f9a1355ce549 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:55.541518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-02321081-410a-4076-9437-5a241bb6849f req-1ceee697-be3a-4a8b-a35b-f9a1355ce549 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:55.542133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-02321081-410a-4076-9437-5a241bb6849f req-1ceee697-be3a-4a8b-a35b-f9a1355ce549 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:55.554282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-02321081-410a-4076-9437-5a241bb6849f req-1ceee697-be3a-4a8b-a35b-f9a1355ce549 service nova] Creating event network-vif-plugged:3334ae2f-5b07-4c8f-9969-546288fe7c42 for instance 93ecbb29-5d49-412c-8436-189fb1a14079 on hv-cinder-80295 Aug 05 14:25:55.559880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-02321081-410a-4076-9437-5a241bb6849f req-1ceee697-be3a-4a8b-a35b-f9a1355ce549 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106525 Aug 05 14:25:55.560520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 53/119] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:55.713297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:55.714137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:55.731056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:55.731577 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:55.731994 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:55.734788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:55.735281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:55.735749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:55.908151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:55.917436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b0e94012-3901-4aee-9411-89879dafcab3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.208506 Aug 05 14:25:55.919232 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 67/120] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:55 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:56.239571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:56.239571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:56.248070 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:56.248928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:56.258167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.260237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.260840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.261339 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.261799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.262766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.263338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.263804 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.264228 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.269271 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.269969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.270472 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.294735 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:56.463819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:56.476114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:56.482452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:56.483946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:56.484217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9e47f2a1-43a8-436a-93dd-e540dbc47791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.240494 Aug 05 14:25:56.484832 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 68/121] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:56 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:56.485265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9208e2b2-4a95-4289-8668-2b61b6734c62 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.253735 Aug 05 14:25:56.490455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 54/122] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:56 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:56.494038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:56.494871 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:56.501282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.501996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.502598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.503329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.504326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.504435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.758514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:56.773511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-227d531b-46a3-4e5a-ae98-4ff5b43a1ec2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.285907 Aug 05 14:25:56.782133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 69/123] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:56 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:56.939934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:56.941103 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:56.950252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.952833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.955181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:56.956212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:56.957484 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:56.961944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.318012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:57.332778 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1705e704-2afb-4cd2-afca-7ea8e945a560 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.397204 Aug 05 14:25:57.334040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 55/124] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:56 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:57.505316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:57.506515 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:57.508724 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=4 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:25:57.511861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:57.512543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:57.516289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.516847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.517313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.518000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.520732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.521180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.522446 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.523219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.523373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.524096 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.524575 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.525227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.920048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:57.926271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:57.928787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:57.930536 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:57.931717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1d98e210-72f6-4b4e-9cf9-d620a375b1b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.425430 Aug 05 14:25:57.932285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 56/125] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:57 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:25:57.937374 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-971f3e50-1d0a-4495-b4de-e1d040c86978 req-56dd1e2f-a0e8-4da1-b473-e7679c654f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145b6612-d562-4fb1-8ef7-35259df1cf19", "name": "network-vif-plugged", "status": "completed", "tag": "5d11bb3d-e647-4217-aeeb-63b14f3f279a"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:57.946605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4c92fe4a-c4a0-4c54-90c7-f66ba427f723 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.445471 Aug 05 14:25:57.948886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-971f3e50-1d0a-4495-b4de-e1d040c86978 req-56dd1e2f-a0e8-4da1-b473-e7679c654f1f service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.949527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-971f3e50-1d0a-4495-b4de-e1d040c86978 req-56dd1e2f-a0e8-4da1-b473-e7679c654f1f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.950205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-971f3e50-1d0a-4495-b4de-e1d040c86978 req-56dd1e2f-a0e8-4da1-b473-e7679c654f1f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.950358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 70/126] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:57 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:57.954966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:57.955574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:57.962427 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.962829 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-971f3e50-1d0a-4495-b4de-e1d040c86978 req-56dd1e2f-a0e8-4da1-b473-e7679c654f1f service nova] Creating event network-vif-plugged:5d11bb3d-e647-4217-aeeb-63b14f3f279a for instance 145b6612-d562-4fb1-8ef7-35259df1cf19 on hv-cinder-80295 Aug 05 14:25:57.962942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.963331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.964021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:57.964762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:57.965371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:57.968367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-971f3e50-1d0a-4495-b4de-e1d040c86978 req-56dd1e2f-a0e8-4da1-b473-e7679c654f1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034591 Aug 05 14:25:57.969736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 57/127] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:25:58.115316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:58.124706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b3981700-7e87-4643-a651-60e98cbcaaa0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.173325 Aug 05 14:25:58.127514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 71/128] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:57 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:58.356056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:58.357251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:58.369240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:58.369719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:58.370153 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:58.370994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:58.371466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:58.371887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:58.516653 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:58.526275 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c7ca4e8d-f644-4800-849d-8c6172ac7607 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.174698 Aug 05 14:25:58.527498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 58/129] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:58 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:58.959002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:58.959723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:58.972109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:58.973007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:58.975221 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:58.975726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:58.976171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:58.976984 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:58.981064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:58.981745 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:58.982702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:58.983570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:58.984190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:58.984824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:58.985524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:58.986096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:59.209631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:59.212964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:59.220674 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ed9958a7-2cc6-49d6-a2cb-58de478a25b3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.252842 Aug 05 14:25:59.222520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 59/130] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:58 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:59.227783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:59.229711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:59.232064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-00695321-d05f-43f4-b0e1-3274afb3b1ce tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.277676 Aug 05 14:25:59.233456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:59.234300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:59.248437 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 72/131] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:25:58 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:25:59.249113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:59.249113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:59.249113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:59.249113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:59.249497 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:59.249497 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:59.439015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:59.447284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7d10912f-321d-45cb-8246-1c590c55baee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.223449 Aug 05 14:25:59.447888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 60/132] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:59 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:59.549779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:25:59.550953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:25:59.560113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:59.560890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:59.561522 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:59.562375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:59.562906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:59.563407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:25:59.743566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:25:59.751103 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6bda261d-f9fd-4195-bc63-6444594cf029 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.205089 Aug 05 14:25:59.751681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 73/133] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:25:59 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:25:59.983346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-387ddc61-b376-4089-94f9-cc29e2b5eb19 req-ef80e58b-9c95-4ac3-9623-32017f33b4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38be03aa-2408-4b4e-a390-cf61d00b5e9e", "name": "network-vif-plugged", "status": "completed", "tag": "8c88e5b0-19b1-4814-8072-21e730bd6899"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:25:59.992916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-387ddc61-b376-4089-94f9-cc29e2b5eb19 req-ef80e58b-9c95-4ac3-9623-32017f33b4c8 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:25:59.993435 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-387ddc61-b376-4089-94f9-cc29e2b5eb19 req-ef80e58b-9c95-4ac3-9623-32017f33b4c8 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:25:59.993864 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-387ddc61-b376-4089-94f9-cc29e2b5eb19 req-ef80e58b-9c95-4ac3-9623-32017f33b4c8 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.004401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-387ddc61-b376-4089-94f9-cc29e2b5eb19 req-ef80e58b-9c95-4ac3-9623-32017f33b4c8 service nova] Creating event network-vif-plugged:8c88e5b0-19b1-4814-8072-21e730bd6899 for instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e on hv-cinder-80295 Aug 05 14:26:00.009178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-387ddc61-b376-4089-94f9-cc29e2b5eb19 req-ef80e58b-9c95-4ac3-9623-32017f33b4c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029488 Aug 05 14:26:00.009824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 61/134] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:00.243805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:00.245553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:00.252897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.254375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.257626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.258550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.259180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.259617 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.262768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:00.265177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:00.271961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.272966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.273711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.274693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.275530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.276100 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.494699 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:00.498883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:00.510313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bedbbd09-6577-406b-9370-21aa5b238d3d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1322 microversion: 2.1 time: 0.270375 Aug 05 14:26:00.511534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 74/135] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:00 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:00.513601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:00.515152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:00.516298 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d0c501fc-bf28-49d3-864d-a1ff80582b04 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.257904 Aug 05 14:26:00.520142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 62/136] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:00 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:00.530928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:00.531114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:00.537736 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.538220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.538655 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.539382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.539831 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.540255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.670477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:00.678594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-76a1001c-7450-4071-9abd-81c5a7d4cffb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.165803 Aug 05 14:26:00.679579 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 75/137] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:00 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:00.773504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:00.774139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:00.786052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.786552 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.786996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.787699 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:00.788156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:00.788622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:00.943055 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:00.951681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e36afb2f-975c-4ccc-98d5-2eb5c276b3ed tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.183874 Aug 05 14:26:00.952248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 63/138] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:00 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:01.530670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:01.531272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:01.538367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:01.538897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:01.538997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.539445 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.539879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.540599 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.541052 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.541494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.545295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.545572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.546004 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.546687 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.547131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.547548 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.737535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:01.744279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:01.745316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cc26211f-7d67-4964-9243-3d209d687cb9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1516 microversion: 2.1 time: 0.218437 Aug 05 14:26:01.745895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 76/139] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:01 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:01.752853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:01.753005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:01.753469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:01.755423 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:01.756786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-fbe42a78-9997-4de7-9aee-11c0e80bb688 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.223204 Aug 05 14:26:01.757333 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 64/140] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:01 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:26:01.763835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.763835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.763835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.763835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.764151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.764151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.771883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:01.774292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:01.780229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.780975 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.781508 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.782682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.783239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.783727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.850659 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lazy-loading 'flavor' on Instance uuid 93ecbb29-5d49-412c-8436-189fb1a14079 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:26:01.951375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:01.960240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eecb725c-c77b-4e91-ba1b-f51f8ccf15f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.213310 Aug 05 14:26:01.962057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 77/141] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:01 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:01.978028 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:01.978642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:01.988627 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.991449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.991449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:01.991449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:01.991449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:01.991848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:02.144948 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:02.154445 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6da0e846-5117-4b1e-81d8-cb97fbd8003f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.180214 Aug 05 14:26:02.164573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 78/142] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:01 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:02.246317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-73da176a-5640-40e1-86ac-e877c06ba350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079/action" status: 200 len: 32 microversion: 2.1 time: 0.479123 Aug 05 14:26:02.246836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 65/143] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:26:01 2022] POST /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 14:26:02.256113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:02.256756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:02.262584 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:02.263060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:02.263488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:02.264170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:02.264643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:02.265061 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:02.269102 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:02.400358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:02.413180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e000c55a-959b-4eac-a20e-c29df31efe61 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.160782 Aug 05 14:26:02.413992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 79/144] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:02 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:02.793382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:02.794741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:02.801897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:02.802686 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:02.803284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:02.804140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:02.804920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:02.805505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:02.958172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:02.966679 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:02.968720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:02.969846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e7db20de-46f7-4429-b530-474eb53d5e00 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.188899 Aug 05 14:26:02.971076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 66/145] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:02 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:02.988247 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:02.988995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:02.996748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:02.997266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:02.998543 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:02.999401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:02.999863 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:03.000557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:03.148009 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:03.157356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ce162c45-5fce-43b2-8860-0426f0e8a033 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.173005 Aug 05 14:26:03.158123 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 80/146] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:02 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:03.176457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:03.177289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:03.185379 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:03.186137 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:03.186578 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:03.187434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:03.187893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:03.188364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:03.388224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:03.400221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2c265c4c-eab0-4349-a8bc-8f967bac7d86 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.228640 Aug 05 14:26:03.403099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 67/147] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:03 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:03.435227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:03.435838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:03.442230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:03.442710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:03.443155 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:03.443855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:03.444319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:03.444768 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:03.597307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:03.604961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-238f62e9-c7be-47a7-8b29-924a03942f37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.173613 Aug 05 14:26:03.605527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 81/148] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:03 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:03.999039 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:04.000523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:04.009966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.011108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.011695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.013727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.016832 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.017468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.178683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:04.179304 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:04.185706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.186427 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.187138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.188043 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.188751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.189397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.214082 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:04.223157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:04.224696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:04.225819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-aed96dc5-e893-4a10-ab17-3eca34f2a53a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.234763 Aug 05 14:26:04.226382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 68/149] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:03 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:04.346426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:04.356030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2558ed8c-18ec-430e-badb-72493a0e6b2f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.181890 Aug 05 14:26:04.370982 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 82/150] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:04 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:04.423290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:04.424395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:04.431101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.431589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.432193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.433208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.433758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.434191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.572612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:04.578877 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-360e1bc0-830b-4bed-a693-2d970223d691 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.159590 Aug 05 14:26:04.579454 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 69/151] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:04 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:04.625651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:04.626269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:04.649910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.650426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.651147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.652001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:04.652633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:04.653244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:04.848787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:04.868990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4b449397-330d-427b-9079-5b3c4189d436 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.246966 Aug 05 14:26:04.870133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 83/152] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:04 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:05.042241 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-509f5cbc-37ab-4dc5-a49e-c2899a5f7679 req-15cef778-eea0-46bd-903e-bf1ddb4d013e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a17e392-41cb-4261-94a6-5f144eefe190", "name": "network-vif-plugged", "status": "completed", "tag": "d2c9fb6e-8b73-4b73-b212-e026732f6ed6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:05.052482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-509f5cbc-37ab-4dc5-a49e-c2899a5f7679 req-15cef778-eea0-46bd-903e-bf1ddb4d013e service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.053283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-509f5cbc-37ab-4dc5-a49e-c2899a5f7679 req-15cef778-eea0-46bd-903e-bf1ddb4d013e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.053776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-509f5cbc-37ab-4dc5-a49e-c2899a5f7679 req-15cef778-eea0-46bd-903e-bf1ddb4d013e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.065663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-509f5cbc-37ab-4dc5-a49e-c2899a5f7679 req-15cef778-eea0-46bd-903e-bf1ddb4d013e service nova] Creating event network-vif-plugged:d2c9fb6e-8b73-4b73-b212-e026732f6ed6 for instance 0a17e392-41cb-4261-94a6-5f144eefe190 on hv-cinder-80295 Aug 05 14:26:05.071580 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-509f5cbc-37ab-4dc5-a49e-c2899a5f7679 req-15cef778-eea0-46bd-903e-bf1ddb4d013e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Aug 05 14:26:05.072181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 70/153] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:26:05.250689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:05.251302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:05.261121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.261121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.261121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.261121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.261394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.261394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.377644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:05.378369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:05.385136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.385627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.386056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.389589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.390254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.390690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.402295 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:05.405881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:05.410066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:05.412258 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:05.413507 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fd362f60-ae30-4fc4-b77f-2195a4956313 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.167283 Aug 05 14:26:05.414147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 84/154] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:05 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:05.529316 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:05.536824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a57dc79b-1de5-4c64-a6d1-7f9e995ac654 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.163395 Aug 05 14:26:05.537404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 71/155] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:05 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:05.601650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:05.602244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:05.608065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.608583 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.609022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.609694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.610142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.610557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.746758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:05.755876 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3f9efa95-fcf8-475d-8217-dc591fa4ff5c tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.158782 Aug 05 14:26:05.756393 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 85/156] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:05 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:05.891225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:05.891936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:05.899595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.900081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.900616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:05.901268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:05.901720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:05.903766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.062405 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:06.062405 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6a22ddcb-12bb-43fa-bccd-38d3e8b4d2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.175005 Aug 05 14:26:06.063140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 72/157] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:05 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:06.437331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:06.437949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:06.439786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:06.445095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:06.445570 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:06.446013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.446705 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:06.447167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:06.447595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.560981 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:06.562118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:06.570701 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:06.571268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:06.572085 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.572885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:06.573450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:06.574069 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.595498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:06.604494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:06.606031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:06.607133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5e06d51f-a591-4e76-9ea2-4a9e4de02fc9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.173744 Aug 05 14:26:06.607985 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 86/158] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:06 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:06.719242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:06.726792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c0088601-0a5d-481d-add3-477a22ad04c2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.172721 Aug 05 14:26:06.727365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 73/159] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:06 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:06.783942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:06.784840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:06.790902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:06.791478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:06.791892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.792625 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:06.793089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:06.793523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:06.929095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:06.936620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e0f422ab-fe55-4238-ae29-d0d0599bf3f3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.156917 Aug 05 14:26:06.937191 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 87/160] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:06 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:07.083931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:07.085434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:07.092099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.092800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.093242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.100123 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.100260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.100662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.237442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:07.245595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-836d31c3-1bf8-4924-a430-d5ad8917e919 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.166473 Aug 05 14:26:07.246170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 74/161] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:07 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:07.629636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:07.630272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:07.636664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.637298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.637773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.638425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.638883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.639318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.746874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:07.747939 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:07.754528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.755316 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.755814 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.756772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.757446 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.758067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.780382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:07.788517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:07.790042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:07.791174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b7a71950-3d26-4024-81c5-2690a091f279 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.165680 Aug 05 14:26:07.799265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 88/162] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:07 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:07.889254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:07.898320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cd0d7670-b255-4921-9904-d18f8d3d0665 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.154986 Aug 05 14:26:07.899221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 75/163] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:07 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:07.957796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:07.958446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:07.964444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.964938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.965402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:07.966090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:07.966812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:07.967239 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:08.109425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:08.118075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a50e40b2-f22c-433f-b106-362b159a6916 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.164379 Aug 05 14:26:08.118646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 89/164] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:07 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:08.266458 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:08.268488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:08.273078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:08.273567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:08.274002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:08.274688 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:08.275139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:08.275564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:08.441358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:08.449099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-27ed75b2-5ace-4e41-a165-faea8878d8c3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.186482 Aug 05 14:26:08.449674 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 76/165] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:08 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:08.813943 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:08.814544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:08.821090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:08.821572 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:08.822000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:08.822685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:08.823139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:08.823554 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:08.919131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:08.919890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:08.927120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:08.930079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:08.930079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:08.930079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:08.930079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:08.930625 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:09.273977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:09.294460 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:09.297982 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:09.301638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f6b5570f-ccbf-46d0-9afb-087cb51901b7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.491545 Aug 05 14:26:09.305769 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 90/166] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:08 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:09.310571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:09.320262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:09.328458 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:09.331915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:09.331915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:09.331915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:09.331915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:09.332220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:09.417127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:09.425881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-44be7d58-171e-4aac-83d4-1913a056f7f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.509451 Aug 05 14:26:09.426335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 77/167] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:08 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:09.470322 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:09.471014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:09.478047 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:09.478891 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:09.479523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:09.480269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:09.480918 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:09.481304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:09.498450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:09.507395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-06714031-6b1f-4a42-9e3d-10afccc4f435 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.199829 Aug 05 14:26:09.522059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 91/168] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:09 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:09.692182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:09.701142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-59d554c6-24c7-41a2-b573-395538cc7469 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.234859 Aug 05 14:26:09.706190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 78/169] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:09 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:10.329195 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:10.329927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:10.336208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.336862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.337379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.338134 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.338647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.339139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.450456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:10.450456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:10.452192 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:10.457167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.458028 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.459023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.460162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.460911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.462126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.561014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:10.584893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:10.588568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:10.592890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ce16dac2-737a-4fcb-acde-7e247ff3a1a0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.265668 Aug 05 14:26:10.594877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 92/170] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:10 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:10.605048 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:10.606296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:10.615213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.615999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.616736 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.617915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.618745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.619851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.653327 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:10.665909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-94eadd91-182c-4e4c-991c-b0d1bd5f7122 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.221811 Aug 05 14:26:10.672270 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 79/171] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:10 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:10.723880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:10.724755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:10.736160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.738666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.739534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:10.740247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:10.740733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:10.746621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:11.028828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:11.036948 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e947f716-a83a-4b70-b0a3-a46ea01dab23 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1315 microversion: 2.1 time: 0.440994 Aug 05 14:26:11.038326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 93/172] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:10 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:11.056233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:11.064244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c53ae1a6-8c7e-441b-9f61-3e20c2810180 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.344774 Aug 05 14:26:11.065345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 80/173] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:10 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:11.149632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-893b56dc-971c-44e5-aa3f-408fb616bcb0 req-efddcead-cc2e-4836-bf74-d2d8b50b3204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "name": "network-vif-plugged", "status": "completed", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:11.161919 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-893b56dc-971c-44e5-aa3f-408fb616bcb0 req-efddcead-cc2e-4836-bf74-d2d8b50b3204 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:11.162408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-893b56dc-971c-44e5-aa3f-408fb616bcb0 req-efddcead-cc2e-4836-bf74-d2d8b50b3204 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:11.162840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-893b56dc-971c-44e5-aa3f-408fb616bcb0 req-efddcead-cc2e-4836-bf74-d2d8b50b3204 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:11.174721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-893b56dc-971c-44e5-aa3f-408fb616bcb0 req-efddcead-cc2e-4836-bf74-d2d8b50b3204 service nova] Creating event network-vif-plugged:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:26:11.180288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-893b56dc-971c-44e5-aa3f-408fb616bcb0 req-efddcead-cc2e-4836-bf74-d2d8b50b3204 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034892 Aug 05 14:26:11.180922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 94/174] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:11.617377 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:11.617986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:11.623833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:11.624315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:11.624790 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:11.636980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:11.636980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:11.636980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:11.690992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:11.692503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:11.699540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:11.700310 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:11.700983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:11.702995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:11.703847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:11.705693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:11.858467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:11.869180 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:11.872746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:11.872746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e1f4c443-19a8-446f-87e7-a448efcaf434 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.259317 Aug 05 14:26:11.873491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 81/175] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:11 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:26:11.919469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:11.928352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-45e68ee8-93e6-4a60-b4bb-ff964db44eb8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.243050 Aug 05 14:26:11.929433 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 95/176] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:11 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:12.060420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:12.061050 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:12.068672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.069379 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.070014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.070711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.071380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.071993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.087423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:12.088075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:12.094936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.095428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.095869 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.096708 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.097193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.098074 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.121134 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:12.272755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:12.282003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-66e9f573-089a-4e3e-97f2-ed53cc385d87 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1501 microversion: 2.1 time: 0.226329 Aug 05 14:26:12.283019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 82/177] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:12 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:12.293238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:12.301138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cf16456c-b813-4395-9a6c-ffe93dea6a71 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.218223 Aug 05 14:26:12.316554 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 96/178] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:12 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:12.895201 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:12.897693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:12.904082 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.905222 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.905707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.906616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.907052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.907477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.952088 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:12.953772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:12.964031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.964904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.966078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:12.967316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:12.968019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:12.969217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:13.140448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:13.152944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:13.154941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:13.156900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4cd2b703-e44d-42fc-abb1-9a163991d40e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.265618 Aug 05 14:26:13.159576 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 83/179] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:12 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:13.217261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:13.226805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-27f3475d-37cf-414f-a454-9ce65353d4e9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1363 microversion: 2.1 time: 0.280306 Aug 05 14:26:13.245762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 97/180] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:12 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:13.323994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:13.324546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:13.330850 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:13.331407 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:13.331842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:13.332602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:13.333087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:13.333507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:13.485683 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:13.496795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-808b7ccb-70c8-42bf-81d5-0c80a098a012 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.175944 Aug 05 14:26:13.497643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 84/181] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:13 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:14.185220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:14.186349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:14.193066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.193550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.197531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.197531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.197531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.197531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.252240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:14.252908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:14.260141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.260728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.261158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.261843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.262292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.262874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.461046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:14.473492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:14.475167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:14.477238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:14.479246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-258788d6-3f89-4b3a-acab-9a26414e94a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1407 microversion: 2.20 time: 0.300893 Aug 05 14:26:14.481072 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 98/182] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:14 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:14.484175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f507ebe9-21e6-4af1-a33a-de0696d61222 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1549 microversion: 2.1 time: 0.235737 Aug 05 14:26:14.485199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 85/183] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:14 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:14.506521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:14.507205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:14.522662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:14.523601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:14.523773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.527801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.527801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.527801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.527801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.528305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.530371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.530937 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.531685 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.532550 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:14.533104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:14.533730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:14.694959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9c7d8abb-0c9e-49f8-952f-c03d5d3cc5aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193195 Aug 05 14:26:14.695555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 99/184] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:26:14 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:14.721377 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:14.736755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f04c508c-0c79-4b6a-bb94-e5277166b2ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.219179 Aug 05 14:26:14.738151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 86/185] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:14 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:15.331721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9586130-6ecc-4157-8eff-2e8db9ffc32f"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:15.336021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:15.343117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:15.343811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:15.344402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:15.345329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:15.346079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:15.347177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:15.502998 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:15.504235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:15.529899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:15.530372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:15.530824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:15.533629 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:15.535048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:15.535556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:15.776196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:15.782219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:15.790538 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:15.793553 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:15.796406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4ec0e35a-66cb-49f0-8a46-f121deda1082 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1598 microversion: 2.20 time: 0.297191 Aug 05 14:26:15.799317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 87/186] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:26:15 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1598 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:26:15.825156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:15.825939 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:15.833896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:15.834624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:15.835456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:15.836584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:15.837256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:15.837893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:16.025190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:16.032540 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1de4c20a-a87f-4219-b00b-ce38921e78b7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.231444 Aug 05 14:26:16.033340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 88/187] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:15 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:16.039158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:16.039654 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:16.045475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:16.045966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:16.046404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:16.047095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:16.047633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:16.048065 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:16.134203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-097ad9ca-83ed-40ef-bbc1-dd80a9c871af tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099766 Aug 05 14:26:16.134813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 89/188] 10.222.0.26 () {60 vars in 1316 bytes} [Fri Aug 5 14:26:16 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:26:16.414075 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-add445fd-6a2c-4556-ae4c-59341358a527 req-117623d3-cb3d-4730-b592-6233607cfc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a17e392-41cb-4261-94a6-5f144eefe190", "tag": "d2c9fb6e-8b73-4b73-b212-e026732f6ed6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:16.440670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-add445fd-6a2c-4556-ae4c-59341358a527 req-117623d3-cb3d-4730-b592-6233607cfc47 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:16.442315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-add445fd-6a2c-4556-ae4c-59341358a527 req-117623d3-cb3d-4730-b592-6233607cfc47 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:16.442315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-add445fd-6a2c-4556-ae4c-59341358a527 req-117623d3-cb3d-4730-b592-6233607cfc47 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:16.463872 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-add445fd-6a2c-4556-ae4c-59341358a527 req-117623d3-cb3d-4730-b592-6233607cfc47 service nova] Creating event network-changed:d2c9fb6e-8b73-4b73-b212-e026732f6ed6 for instance 0a17e392-41cb-4261-94a6-5f144eefe190 on hv-cinder-80295 Aug 05 14:26:16.471191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-add445fd-6a2c-4556-ae4c-59341358a527 req-117623d3-cb3d-4730-b592-6233607cfc47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059949 Aug 05 14:26:16.471290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 90/189] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:26:16.889680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bc1b11e8-8d1a-4d9e-991c-0e928ef1d365 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "POST /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.562914 Aug 05 14:26:16.890811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 100/190] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:26:15 2022] POST /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e/os-volume_attachments => generated 194 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:17.055370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:17.056104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:17.072277 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:17.073905 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:17.075147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:17.078910 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:17.079717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:17.080746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:17.470139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:17.481364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-fe101468-51af-4030-945b-26be56563caa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.430843 Aug 05 14:26:17.488012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 91/191] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:17 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:18.226233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-a4700f32-2233-4ee7-acb6-2eb8e94693ea req-b5311f55-aa00-46ef-9949-7da533d91543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:18.274140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-a4700f32-2233-4ee7-acb6-2eb8e94693ea req-b5311f55-aa00-46ef-9949-7da533d91543 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:18.275042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-a4700f32-2233-4ee7-acb6-2eb8e94693ea req-b5311f55-aa00-46ef-9949-7da533d91543 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:18.275726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-a4700f32-2233-4ee7-acb6-2eb8e94693ea req-b5311f55-aa00-46ef-9949-7da533d91543 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:18.292236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-a4700f32-2233-4ee7-acb6-2eb8e94693ea req-b5311f55-aa00-46ef-9949-7da533d91543 service nova] Creating event network-changed:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:26:18.298010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-a4700f32-2233-4ee7-acb6-2eb8e94693ea req-b5311f55-aa00-46ef-9949-7da533d91543 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079619 Aug 05 14:26:18.302035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 101/192] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:18.502897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:18.504796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:18.514837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:18.519045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:18.519045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:18.519045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:18.519750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:18.520707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:18.762571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:18.775214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f421428a-2d74-4761-b657-3c3c072cf599 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.276307 Aug 05 14:26:18.776821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 92/193] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:18 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:19.800687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:19.806772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:19.820652 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:19.825119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:19.825695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:19.826538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:19.827319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:19.827976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:20.024619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:20.032302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3f368109-8e58-44a9-bb47-782c3d942d84 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.236831 Aug 05 14:26:20.036448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 102/194] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:19 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:21.052752 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:21.053362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:21.060928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:21.061510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:21.061936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:21.062724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:21.063177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:21.063599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:21.210331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:21.222200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6daeb3b3-ae0e-493c-9f9c-07b6c528695e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.172971 Aug 05 14:26:21.224611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 93/195] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:21 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:22.244024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:22.249497 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:22.251217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:22.251707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:22.252151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:22.253719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:22.254300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:22.254738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:22.394615 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:22.402265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f326c8e6-4321-4675-8a7f-9523e6733e0e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.162044 Aug 05 14:26:22.402834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 103/196] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:22 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:23.423189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:23.425228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:23.431336 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:23.431955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:23.432516 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:23.433391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:23.433927 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:23.437763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:23.579487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:23.587666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bc0aefd6-2159-4487-a634-f74b758570d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.168406 Aug 05 14:26:23.588235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 94/197] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:23 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:24.609341 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:24.609964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:24.617002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:24.617494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:24.617947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:24.618643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:24.619101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:24.619528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:24.779038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:24.787092 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7fb3f29b-4b8b-4cb3-86f2-00b0c6a91d27 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.181781 Aug 05 14:26:24.787649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 104/198] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:24 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:25.808437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:25.809041 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:25.815118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:25.815598 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:25.816171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:25.816744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:25.817237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:25.817652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:25.959112 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:25.969713 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ec3aa281-9d3e-40b2-9ad1-0032884e0db4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.163814 Aug 05 14:26:25.969713 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 95/199] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:25 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:26.989268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:26.989875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:26.996330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:26.996849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:26.997288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:26.997970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:26.998425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:26.998846 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:27.141557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:27.150163 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-627a347e-04c3-428d-8387-ffe6c8b8401e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.164691 Aug 05 14:26:27.150733 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 105/200] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:26 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:28.171252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:28.171858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:28.177854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:28.178348 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:28.179049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:28.179569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:28.180023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:28.180463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:28.317703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:28.325325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d8ea0bd6-8314-42b9-9942-56b9532e8245 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.157955 Aug 05 14:26:28.325892 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 96/201] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:28 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:29.347414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:29.348032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:29.355023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:29.355511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:29.355947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:29.356662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:29.362361 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:29.362361 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:29.498678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:29.506164 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0a44cd9d-0ff2-484e-b188-64330f4f736d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.162670 Aug 05 14:26:29.507268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 106/202] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:29 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:30.530897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:30.531517 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:30.537467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:30.538775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:30.539436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:30.540131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:30.540640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:30.541071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:30.668075 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:30.675676 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-73f7d6ab-2e10-441c-b7f9-67ccecdd0e9d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.148613 Aug 05 14:26:30.676256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 97/203] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:30 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:31.696716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:31.697339 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:31.703788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:31.704265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:31.704729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:31.705403 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:31.705853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:31.706271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:31.839441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:31.847127 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c65d9586-5dab-47d8-9695-e153e2811433 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.154479 Aug 05 14:26:31.847690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 107/204] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:31 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:32.166736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:32.168136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:32.174289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:32.174775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:32.175212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:32.176004 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:32.176463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:32.176794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:32.202688 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:26:32.546892 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-06e994bc-6d36-4d9c-b9d6-3d838cc40996 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 204 len: 0 microversion: 2.1 time: 0.384773 Aug 05 14:26:32.547579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 98/205] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:26:32 2022] DELETE /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:26:32.560098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:32.560731 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:32.566643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:32.567122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:32.567555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:32.568232 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:32.568745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:32.569807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:32.736968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:32.746278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e01b8050-c67d-47c0-b44a-1d37534af8c5 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1553 microversion: 2.1 time: 0.189767 Aug 05 14:26:32.747046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 108/206] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:32 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:32.870172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:32.870870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:32.879220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:32.879220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:32.879220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:32.879220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:32.879636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:32.880064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:33.031317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:33.042836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-384cea0e-a36b-40b5-822d-160193c684d9 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.177570 Aug 05 14:26:33.043432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 99/207] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:32 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:33.769143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:33.769770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:33.776062 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:33.776628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:33.777067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:33.777767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:33.778220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:33.778833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:33.919420 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:33.928308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b7831b39-1370-4c7f-8023-f932b842f553 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1553 microversion: 2.1 time: 0.162923 Aug 05 14:26:33.930056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 109/208] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:33 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:34.065000 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:34.065613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:34.072808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:34.073296 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:34.073728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:34.074450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:34.074893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:34.075304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:34.212821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:34.222132 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-46c7c22b-4b91-4ca3-bd4f-fc8ace161551 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.160921 Aug 05 14:26:34.222737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 100/209] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:34 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:34.950596 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:34.951198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:34.957575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:34.960725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:34.960725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:34.960725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:34.960725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:34.961169 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:35.174743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:35.183763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bb790b6b-1fbe-47f2-ae6e-564bc05dcb6f tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1553 microversion: 2.1 time: 0.237032 Aug 05 14:26:35.184450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 110/210] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:34 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:35.244405 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:35.245037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:35.253072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:35.253849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:35.254330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:35.255094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:35.255543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:35.255964 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:35.444262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:35.451790 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-86ecea5f-b828-4f73-b372-2c067dfa1712 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.211552 Aug 05 14:26:35.452459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 101/211] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:35 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:36.205462 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:36.206208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:36.215930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:36.221965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:36.222428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:36.223157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:36.223650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:36.224139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:36.440054 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:36.464538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-225a59d0-cd7d-4b04-82bc-6398c7d9b6ff tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1553 microversion: 2.1 time: 0.261907 Aug 05 14:26:36.472634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 111/212] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:36 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:36.484273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:36.485491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:36.523487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:36.523487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:36.523487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:36.523487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:36.524264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:36.524264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:36.557293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-f43187df-a4de-42df-8c30-fec2e4ca9058 req-6d831ceb-ffd9-4220-926a-2488491709c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38be03aa-2408-4b4e-a390-cf61d00b5e9e", "name": "network-vif-deleted", "tag": "8c88e5b0-19b1-4814-8072-21e730bd6899"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:36.571047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f43187df-a4de-42df-8c30-fec2e4ca9058 req-6d831ceb-ffd9-4220-926a-2488491709c0 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:36.571616 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f43187df-a4de-42df-8c30-fec2e4ca9058 req-6d831ceb-ffd9-4220-926a-2488491709c0 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:36.574559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f43187df-a4de-42df-8c30-fec2e4ca9058 req-6d831ceb-ffd9-4220-926a-2488491709c0 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:36.587510 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-f43187df-a4de-42df-8c30-fec2e4ca9058 req-6d831ceb-ffd9-4220-926a-2488491709c0 service nova] Creating event network-vif-deleted:8c88e5b0-19b1-4814-8072-21e730bd6899 for instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e on hv-cinder-80295 Aug 05 14:26:36.593941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-f43187df-a4de-42df-8c30-fec2e4ca9058 req-6d831ceb-ffd9-4220-926a-2488491709c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041750 Aug 05 14:26:36.595002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 112/213] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:26:36.714197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:36.722105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dec62a49-af97-480b-85b1-730bb482d58f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.247217 Aug 05 14:26:36.722695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 102/214] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:36 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:37.488234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:37.489095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:37.491337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=54 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:37.496518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:37.497012 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:37.497451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:37.498321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:37.498959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:37.499379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:37.525116 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:37.588003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:37.608849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f94409b9-0d9e-4254-b19d-3c97ee02b69a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1511 microversion: 2.1 time: 0.124680 Aug 05 14:26:37.642118 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 113/215] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:37 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:37.743260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:37.744017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:37.750777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:37.751173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:37.751608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:37.752288 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:37.752926 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:37.753613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:37.916742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:37.920736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:37.925970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-99bb988a-fcd1-44b6-8df4-6c2f9748970e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.186605 Aug 05 14:26:37.927136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 103/216] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:37 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:38.637894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:38.639644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:38.649620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:38.650372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:38.650814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:38.651915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:38.652385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:38.652882 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:38.688033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:38.688553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:38.689007 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:38.689451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lazy-loading 'fault' on Instance uuid 38be03aa-2408-4b4e-a390-cf61d00b5e9e {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:26:38.738927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:38.748172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7bff0b88-f24d-4004-a368-e6bc56fe8f5a tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1351 microversion: 2.1 time: 0.114645 Aug 05 14:26:38.748845 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 114/217] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:38 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:38.948394 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:38.949183 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:38.958930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:38.959499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:38.960061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:38.961039 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:38.961499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:38.962599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:39.105454 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:39.113903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c68e7896-b50d-4fac-bb13-32890aa58647 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1522 microversion: 2.1 time: 0.169950 Aug 05 14:26:39.114503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 104/218] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:38 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:39.769913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:39.770523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:39.777977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:39.778679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:39.779122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:39.779816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:39.780274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:39.780722 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:39.810917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:39.811397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:39.811835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:39.812279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lazy-loading 'fault' on Instance uuid 38be03aa-2408-4b4e-a390-cf61d00b5e9e {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:26:39.860723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbe964ead724a4da59620786b5706d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f448f6bc5845d1b0567924c78a6162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:39.869283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fa8540bc-cd03-4f03-b179-f430d2d92605 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 200 len: 1351 microversion: 2.1 time: 0.103644 Aug 05 14:26:39.869851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 115/219] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:39 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:40.136365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:40.136989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:40.143500 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:40.143975 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:40.144402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:40.145409 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:40.146108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:40.146527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:40.281746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:40.289398 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-efd6b5b8-10d2-4835-b4e2-b86040cca911 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1502 microversion: 2.1 time: 0.158136 Aug 05 14:26:40.289963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 105/220] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:40 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:40.309852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:40.310466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:40.316360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:40.316895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:40.317334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:40.318027 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:40.319245 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:40.320105 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:40.453042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:40.460569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c42fbabd-58a8-41f5-ade7-1e597e8701fa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1515 microversion: 2.1 time: 0.154615 Aug 05 14:26:40.461140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 116/221] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:40 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:40.891373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:40.892491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:40.895709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:26:40.901795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:40.905387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:40.905387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:40.905387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:40.905387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:40.905925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:40.924170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] HTTP exception thrown: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Request method failure captured: Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e HTTP/1.1 Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShTGj3KTJ3bf5lY3WUDVvIDoFEoIhyFJ3UDcNdGcuF0r9PJsIEF9S4xnGHKQRj8dmrPpkBZsHDteYdcikuB_iBGOgh8Oq0k45OqljwTDLAJNtXjSSoVuDvOIz-ZD9ieWJx2dZD5UnRUC2aQk-A9FxhtFob8yZ_0o8SEly9OQB3_VAw Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:26:40.934352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85f448f6bc5845d1b0567924c78a6162", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 3bbe964ead724a4da59620786b5706d8 Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:40.935819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '38be03aa-2408-4b4e-a390-cf61d00b5e9e'} Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:26:40.936551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:40.937684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:40.938882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Returning 404 to user: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:26:40.938882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-10f73fea-f476-4aad-af8f-81a0790da9e3 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 404 len: 111 microversion: 2.1 time: 0.050179 Aug 05 14:26:40.938882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 106/222] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:40 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:26:41.098072 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:41.101078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:41.107603 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:41.108091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:41.108645 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:41.111503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:41.111503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:41.111503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:41.125470 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] HTTP exception thrown: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Request method failure captured: Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e/os-volume_attachments HTTP/1.1 Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShTGj3KTJ3bf5lY3WUDVvIDoFEoIhyFJ3UDcNdGcuF0r9PJsIEF9S4xnGHKQRj8dmrPpkBZsHDteYdcikuB_iBGOgh8Oq0k45OqljwTDLAJNtXjSSoVuDvOIz-ZD9ieWJx2dZD5UnRUC2aQk-A9FxhtFob8yZ_0o8SEly9OQB3_VAw Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:26:41.129930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85f448f6bc5845d1b0567924c78a6162", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 3bbe964ead724a4da59620786b5706d8 Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:41.131408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'server_id': '38be03aa-2408-4b4e-a390-cf61d00b5e9e'} Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:26:41.132463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:41.134095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:41.135455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Returning 404 to user: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:26:41.135455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6000a1b5-defc-4809-abed-ca28a0207ea6 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038758 Aug 05 14:26:41.135455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 117/223] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:26:41 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:26:42.929267 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:42.931597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:42.937889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:42.938815 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:42.939430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:42.940120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:42.940812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:42.941228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:42.969925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lazy-loading 'flavor' on Instance uuid 145b6612-d562-4fb1-8ef7-35259df1cf19 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:26:43.266524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d34b17fd-3d8c-4b63-9517-04f8a86d1e7c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/action" status: 200 len: 32 microversion: 2.1 time: 0.341465 Aug 05 14:26:43.267141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 107/224] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:26:42 2022] POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:26:43.277539 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:43.278301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:43.287505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:43.288121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:43.288629 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:43.289416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:43.289914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:43.290376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:43.430469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:43.438021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a620cb38-66e8-4526-bc61-19b149a256b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.164479 Aug 05 14:26:43.442482 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 118/225] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:43 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:43.996344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:43.997054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:44.003983 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:44.004588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:44.005269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:44.006074 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:44.006617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:44.007174 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:44.033277 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] HTTP exception thrown: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Request method failure captured: Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e HTTP/1.1 Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShTGj3KTJ3bf5lY3WUDVvIDoFEoIhyFJ3UDcNdGcuF0r9PJsIEF9S4xnGHKQRj8dmrPpkBZsHDteYdcikuB_iBGOgh8Oq0k45OqljwTDLAJNtXjSSoVuDvOIz-ZD9ieWJx2dZD5UnRUC2aQk-A9FxhtFob8yZ_0o8SEly9OQB3_VAw Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:26:44.035258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85f448f6bc5845d1b0567924c78a6162", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 3bbe964ead724a4da59620786b5706d8 Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.036708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '38be03aa-2408-4b4e-a390-cf61d00b5e9e'} Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:26:44.038209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.039486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.040803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Returning 404 to user: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:26:44.040985 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-142388d2-b7e2-45e1-84f2-24fa42444e06 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 404 len: 111 microversion: 2.1 time: 0.044989 Aug 05 14:26:44.041583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 108/226] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:26:43 2022] DELETE /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:26:44.050047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:44.050746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] [instance: 38be03aa-2408-4b4e-a390-cf61d00b5e9e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:44.058414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:44.058908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:44.059346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:44.060037 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:44.060518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:44.060942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:44.080234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] HTTP exception thrown: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Request method failure captured: Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e HTTP/1.1 Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShTGj3KTJ3bf5lY3WUDVvIDoFEoIhyFJ3UDcNdGcuF0r9PJsIEF9S4xnGHKQRj8dmrPpkBZsHDteYdcikuB_iBGOgh8Oq0k45OqljwTDLAJNtXjSSoVuDvOIz-ZD9ieWJx2dZD5UnRUC2aQk-A9FxhtFob8yZ_0o8SEly9OQB3_VAw Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:26:44.082682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85f448f6bc5845d1b0567924c78a6162", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85f448f6bc5845d1b0567924c78a6162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 85f448f6bc5845d1b0567924c78a6162 Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-DeleteServersTestJSON-40489784 Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 3bbe964ead724a4da59620786b5706d8 Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-DeleteServersTestJSON-40489784-project Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.084815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '38be03aa-2408-4b4e-a390-cf61d00b5e9e'} Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:26:44.085654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. Aug 05 14:26:44.086980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:44.088177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] Returning 404 to user: Instance 38be03aa-2408-4b4e-a390-cf61d00b5e9e could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:26:44.088177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-234b438b-17a8-4ebc-9bad-7c8bb53bbc90 tempest-DeleteServersTestJSON-40489784 tempest-DeleteServersTestJSON-40489784-project] 10.222.0.26 "GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e" status: 404 len: 111 microversion: 2.1 time: 0.040615 Aug 05 14:26:44.088177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 119/227] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:44 2022] GET /compute/v2.1/servers/38be03aa-2408-4b4e-a390-cf61d00b5e9e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:26:44.459880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:44.460528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:44.467383 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:44.467859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:44.468283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:44.468990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:44.469433 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:44.469848 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:44.717026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:44.724465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cfbbc8c0-931d-454d-b03a-19d2c3d76c19 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.269179 Aug 05 14:26:44.725521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 109/228] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:44 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:45.747099 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:45.747832 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:45.755521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:45.757820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:45.757820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:45.758139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:45.758421 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:45.759348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:45.992919 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:46.028878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-32fbcfb6-c78e-400e-8a77-b4a0a16e76f3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.276473 Aug 05 14:26:46.029559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 120/229] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:45 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:47.051660 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:47.052262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:47.058317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:47.058800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:47.059277 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:47.065285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:47.065285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:47.065285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:47.201172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:47.208610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9c907f75-7a3e-436a-85cd-35d7b85d9613 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.160844 Aug 05 14:26:47.209860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 110/230] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:47 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:48.231304 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:48.231924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:48.240824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:48.240824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:48.240824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:48.240824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:48.241268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:48.241678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:48.403419 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:48.411291 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-22278aa4-f6b3-41c5-a8d2-e41e8e44a208 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.184142 Aug 05 14:26:48.412932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 121/231] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:48 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:49.433619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:49.434220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:49.440139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:49.440663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:49.441099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:49.441786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:49.442276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:49.442690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:49.574599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:49.582275 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d583eb9b-abb9-4d34-ac77-05af99d1c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.153231 Aug 05 14:26:49.583847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 111/232] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:49 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:50.603220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:50.604555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:50.611064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4ef56ef6-e421-48f1-bc8a-330331f30a3a tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Action: 'create', calling method: .version_select at 0x7fa75d4a1790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-471808899", "metadata": {"Type": "work"}}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:50.611652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:50.612350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:50.613141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:50.614053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:50.614706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:50.615134 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:50.775457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:50.783140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e3d300a5-21ee-46c4-a1a2-8bc7ea080c9b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.183938 Aug 05 14:26:50.783802 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 112/233] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:50 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:51.275964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4ef56ef6-e421-48f1-bc8a-330331f30a3a tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.888082 Aug 05 14:26:51.276615 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 122/234] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Aug 5 14:26:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 889 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 14:26:51.288807 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1f14d0f0-c607-48b0-85e8-692ea4b2a000 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75e466790>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:51.353313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1f14d0f0-c607-48b0-85e8-692ea4b2a000 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 200 len: 352 microversion: 2.1 time: 0.068269 Aug 05 14:26:51.353961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 113/235] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:26:51 2022] GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:51.806069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:51.806687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:51.813291 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:51.813783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:51.814234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:51.814913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:51.815367 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:51.815801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:51.992083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:51.999778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-42300ef1-f41c-4aff-b9fb-cd5d40dccb7e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.198736 Aug 05 14:26:52.000352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 123/236] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:51 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:52.367339 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c50d0e9f-f55a-4c6f-980e-4271ffe10bcf tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75e4661f0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:52.415044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c50d0e9f-f55a-4c6f-980e-4271ffe10bcf tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 200 len: 352 microversion: 2.1 time: 0.051740 Aug 05 14:26:52.415614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 114/237] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:26:52 2022] GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:53.021586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:53.022261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:53.029321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:53.029827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:53.033973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:53.033973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:53.033973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:53.033973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:53.174782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:53.182802 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5b04a7ea-d43e-4b32-a403-d72c45f2061d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.165889 Aug 05 14:26:53.183373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 124/238] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:53 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:53.429447 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ca604c46-ba59-4529-8d8b-c6d99eefacb4 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75e6c2280>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:53.476722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ca604c46-ba59-4529-8d8b-c6d99eefacb4 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 200 len: 353 microversion: 2.1 time: 0.051259 Aug 05 14:26:53.477390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 115/239] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:26:53 2022] GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:53.496639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2d258f25-2b0b-4a7e-b3f9-e81049ee1163 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75d460ee0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:53.550782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2d258f25-2b0b-4a7e-b3f9-e81049ee1163 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 200 len: 353 microversion: 2.1 time: 0.057832 Aug 05 14:26:53.551752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 125/240] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:26:53 2022] GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:53.570447 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-eba743d1-3ef0-4ca8-9bd0-dc5596cefa8e tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75e468550>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:53.756779 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-eba743d1-3ef0-4ca8-9bd0-dc5596cefa8e tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 202 len: 0 microversion: 2.1 time: 0.190689 Aug 05 14:26:53.757434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 116/241] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:26:53 2022] DELETE /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:26:53.765910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0383cdd2-5798-4e2b-b4c4-9f451dcca212 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75d460a60>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:53.812880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0383cdd2-5798-4e2b-b4c4-9f451dcca212 tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 200 len: 352 microversion: 2.1 time: 0.050788 Aug 05 14:26:53.813461 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 126/242] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:26:53 2022] GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:26:54.203674 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:54.204291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:54.210507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:54.210993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:54.211543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:54.212244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:54.212786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:54.213200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:54.355305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:54.362836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bcd902f7-283e-40eb-bb9f-51a94930dc37 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.163430 Aug 05 14:26:54.363338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 117/243] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:54 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:54.827115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de919284-99d0-421b-abf3-8f0ce4d931ac tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Calling method '.version_select at 0x7fa75d5653a0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:54.856971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-de919284-99d0-421b-abf3-8f0ce4d931ac tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] HTTP exception thrown: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de919284-99d0-421b-abf3-8f0ce4d931ac tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Request method failure captured: Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 HTTP/1.1 Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SiqzURrP2Bh8e4re2oWxwTaKBw3s1qAKvDp2nsC0E-LaBjkliX85jB4w8kp-KitVDYtOemeiyjKSFmEIxRcvKxo2uENW_TZnnLYyWFNAJT6dgSbqbPXSFw4OS_PVr-nQ7eiTCQWhLY6wYcGd8_C_gPPNrxUOoM15qJDPNO-5bIFkyc Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 05567514c1b14aa2a7703e8ae3be25e0 Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesGetTestJSON-1992209347 Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:26:54.858996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05567514c1b14aa2a7703e8ae3be25e0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05567514c1b14aa2a7703e8ae3be25e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05567514c1b14aa2a7703e8ae3be25e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05567514c1b14aa2a7703e8ae3be25e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesGetTestJSON-1992209347 Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 05567514c1b14aa2a7703e8ae3be25e0 Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesGetTestJSON-1992209347 Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesGetTestJSON-1992209347-project Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 775b96e827b64beca04b157046bff883 Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesGetTestJSON-1992209347-project Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'bc74e687-d77a-4978-92a4-7e51468c0359'} Aug 05 14:26:54.860215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. (HTTP 404) (Request-ID: req-0c0063ba-968a-498e-924b-56d1d0cb66e4) Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:54.861018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:26:54.862183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 14:26:54.863246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de919284-99d0-421b-abf3-8f0ce4d931ac tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] Returning 404 to user: Volume bc74e687-d77a-4978-92a4-7e51468c0359 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-de919284-99d0-421b-abf3-8f0ce4d931ac tempest-VolumesGetTestJSON-1992209347 tempest-VolumesGetTestJSON-1992209347-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359" status: 404 len: 109 microversion: 2.1 time: 0.037899 Aug 05 14:26:54.865760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 127/244] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:26:54 2022] GET /compute/v2.1/os-volumes/bc74e687-d77a-4978-92a4-7e51468c0359 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:26:55.384444 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:55.385452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:55.398194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:55.398806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:55.399239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:55.399932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:55.400385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:55.400830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:55.535190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:55.543407 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7e30910c-6ff9-409e-b9d1-36d7587e0553 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.163694 Aug 05 14:26:55.543980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 118/245] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:55 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:56.566762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:56.567404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:56.575353 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:56.575941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:56.576387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:56.577131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:56.577591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:56.578022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:56.715530 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:56.723423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-635b9b5e-7861-475a-93df-14c4025d7eee tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.162172 Aug 05 14:26:56.724000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 128/246] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:56 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:57.269411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1587132054", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:26:57.346957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] validate_networks() for None {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:26:57.644946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:26:57.645364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:26:57.645833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:26:57.646234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:26:57.646845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:26:57.661178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:57.661745 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:57.662114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:57.663840 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:57.664307 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:57.664776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:57.682248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Getting quotas for project 33905000a2f64751b88bbff67918d252. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:26:57.686266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Getting quotas for user 487d7e4081414c2193cb01ff0a202a6b and project 33905000a2f64751b88bbff67918d252. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:26:57.698824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:26:57.701150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:26:57.745406 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:57.746017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:57.753359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:57.755340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:57.755340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:57.755340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:57.756283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:57.757363 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:57.823557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-94c43a1a-904b-44fe-8e89-7738624ae3d3 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557840 Aug 05 14:26:57.824215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 119/247] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:26:57.836067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-916bf974-5240-4941-a994-62bfa2066843 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:57.836712 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-916bf974-5240-4941-a994-62bfa2066843 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:58.097868 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-916bf974-5240-4941-a994-62bfa2066843 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:58.104364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-916bf974-5240-4941-a994-62bfa2066843 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1215 microversion: 2.1 time: 0.273076 Aug 05 14:26:58.104965 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 120/248] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:57 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:58.170028 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:58.177419 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-808e7387-64e3-4358-8c01-b352b111beaa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.435907 Aug 05 14:26:58.177981 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 129/249] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:57 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:26:59.125526 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:59.126183 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:59.133768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:59.134255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:59.134691 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:59.135383 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:59.135845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:59.136270 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:59.199654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:26:59.200189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:59.201068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:26:59.207610 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:59.208132 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-eabe8f84-5bcd-4fe8-a772-708aaf2132a1 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1219 microversion: 2.1 time: 0.086599 Aug 05 14:26:59.208521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:59.208775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 121/250] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:59 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:26:59.209376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:59.210663 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:26:59.211282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:26:59.212013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:26:59.344988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:26:59.353436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6b507699-cfc8-485b-b009-59260c12c0cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.158119 Aug 05 14:26:59.354071 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 130/251] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:26:59 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:00.228709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:00.229316 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:00.235301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:00.235786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:00.236218 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:00.236950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:00.237402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:00.237821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:00.297454 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:00.305455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-36864eef-264b-4c59-b164-efd82cb7ff15 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1219 microversion: 2.1 time: 0.080631 Aug 05 14:27:00.306002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 122/252] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:00 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:00.375965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:00.376645 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:00.383505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:00.384003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:00.384465 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:00.385172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:00.385631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:00.386063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:00.522376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:00.532399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-38ce6cd0-1593-4f56-9807-a62d1f5ef8ca tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.160184 Aug 05 14:27:00.533017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 131/253] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:00 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:01.325304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:01.325912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:01.331819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:01.332300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:01.332767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:01.333498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:01.333960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:01.334375 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:01.409936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:01.418142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ec698ed8-27ea-4f17-8b0d-ea4612340290 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1267 microversion: 2.1 time: 0.096574 Aug 05 14:27:01.418720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 123/254] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:01 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:01.558772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:01.559362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:01.565639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:01.566112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:01.566547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:01.567218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:01.567669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:01.568087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:01.705695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:01.716681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4973b298-832e-4bac-9bce-822ea70cef80 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.162185 Aug 05 14:27:01.717269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 132/255] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:01 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:02.439151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:02.439824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:02.446158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.446747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.447220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.447903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.448358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.448789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.514220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:02.522245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-904ebb0a-0af9-44ad-81f6-1339cf645dd0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1267 microversion: 2.1 time: 0.086949 Aug 05 14:27:02.523684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 124/256] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:02 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:02.738820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:02.739365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:02.746676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.747166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.747997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.748738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.749193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.749619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.885114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:02.892839 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c3983490-d6d5-4b24-9161-1089a650ea2c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1501 microversion: 2.1 time: 0.157972 Aug 05 14:27:02.894053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 133/257] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:02 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:02.915240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48f9b821-ab13-4cee-89f5-81d28332c748"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:02.917776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:02.923857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.924347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.924845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.925725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.926184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.926732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.946360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:02.952474 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] HTTP exception thrown: Cannot 'attach_volume' instance 145b6612-d562-4fb1-8ef7-35259df1cf19 while it is in vm_state rescued Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Request method failure captured: Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/os-volume_attachments HTTP/1.1 Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 74 Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShLeOGY3xgmoxbysO01GVLxdm7-SDIsutDqL0n72iPn3pT8haewb_NYOn5hSSjZT_Kt7bqRoRNgPeDTj8F0yshVjFRjQGjqPhSmi02yVuH86Bz5hiIYU6x0rFEYBr-JrCmCoIIVKx0jXYhc2ruelY7owXiKVaN8ma1VXdN7I8OpDzw Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:27:02.954274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8725df4ddc2b4ec8accc5b0bd7b39a49", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: b9d62fe4e6de4308a3a51be3e900625f Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {"volumeAttachment": {"volumeId": "48f9b821-ab13-4cee-89f5-81d28332c748"}} Aug 05 14:27:02.955492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Cannot 'attach_volume' instance 145b6612-d562-4fb1-8ef7-35259df1cf19 while it is in vm_state rescued Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'server_id': '145b6612-d562-4fb1-8ef7-35259df1cf19', 'body': {'volumeAttachment': {'volumeId': '48f9b821-ab13-4cee-89f5-81d28332c748'}}} Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:27:02.956162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 145b6612-d562-4fb1-8ef7-35259df1cf19 while it is in vm_state rescued Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:27:02.957278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:27:02.958302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:27:02.958302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:27:02.958302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 145b6612-d562-4fb1-8ef7-35259df1cf19 while it is in vm_state rescued Aug 05 14:27:02.958302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:02.958302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Returning 409 to user: Cannot 'attach_volume' instance 145b6612-d562-4fb1-8ef7-35259df1cf19 while it is in vm_state rescued {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:27:02.958302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a0d8d3c5-c58d-4611-bd33-fb3dee44238f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046224 Aug 05 14:27:02.959160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 125/258] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:27:02 2022] POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 14:27:02.965526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:02.966142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:02.972120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.972644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.973082 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:02.973767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:02.974212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:02.974636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:03.005389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:03.372264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7d0f7b1c-afac-4e54-89b8-e96b890dae68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/action" status: 202 len: 0 microversion: 2.1 time: 0.410717 Aug 05 14:27:03.373457 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 134/259] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:27:02 2022] POST /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:27:03.382875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:03.383491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:03.389986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:03.390798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:03.391093 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:03.391795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:03.392248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:03.392702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:03.541163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:03.550777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-280f638e-d3be-497b-8996-c9d275c07e6f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1509 microversion: 2.1 time: 0.172133 Aug 05 14:27:03.551023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:03.551637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:03.551948 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 126/260] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:03 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:03.565011 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:03.565558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:03.566242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:03.566967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:03.567509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:03.567937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:03.646810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:03.656738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9a54df11-5f10-4d74-9eb9-8734b9c2888a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1273 microversion: 2.1 time: 0.116331 Aug 05 14:27:03.657707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 135/261] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:03 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:04.571974 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:04.575389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:04.579551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:04.579949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:04.580581 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:04.581272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:04.581720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:04.582136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:04.686263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:04.686855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:04.695928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:04.696771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:04.697517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:04.698423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:04.699110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:04.699870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:04.821029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:04.830952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-82138604-1ebf-4d2a-9f60-68b96310d7f1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1509 microversion: 2.1 time: 0.262790 Aug 05 14:27:04.845424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 127/262] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:04 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:04.935022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:04.947218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-55f73a3f-8ebb-445f-9336-a9e055570eb0 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.264133 Aug 05 14:27:04.948083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 136/263] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:04 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:05.473354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-590a2a43-4f6f-4c6d-9456-9294a0dce7bd req-4b6d0a5f-772e-4683-b04f-24e74d1179e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a937e1a-c8d4-422a-a8bb-8ac896f262dc", "tag": "98ffda8e-29e3-4f27-9dbd-aa9a0ff73ff2"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:05.495796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-590a2a43-4f6f-4c6d-9456-9294a0dce7bd req-4b6d0a5f-772e-4683-b04f-24e74d1179e2 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:05.496711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-590a2a43-4f6f-4c6d-9456-9294a0dce7bd req-4b6d0a5f-772e-4683-b04f-24e74d1179e2 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:05.497342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-590a2a43-4f6f-4c6d-9456-9294a0dce7bd req-4b6d0a5f-772e-4683-b04f-24e74d1179e2 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:05.530175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-590a2a43-4f6f-4c6d-9456-9294a0dce7bd req-4b6d0a5f-772e-4683-b04f-24e74d1179e2 service nova] Creating event network-changed:98ffda8e-29e3-4f27-9dbd-aa9a0ff73ff2 for instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc on hv-cinder-80295 Aug 05 14:27:05.535627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-590a2a43-4f6f-4c6d-9456-9294a0dce7bd req-4b6d0a5f-772e-4683-b04f-24e74d1179e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066397 Aug 05 14:27:05.542568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 128/264] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:05.854358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:05.854979 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:05.861363 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:05.861868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:05.862382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:05.863096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:05.863546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:05.863963 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:05.969146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:05.970167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:05.977527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:05.978006 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:05.982018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:05.982018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:05.982018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:05.982018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:06.006432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:06.014595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0617bc9d-1a82-4c30-9536-a9b070f1f375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1509 microversion: 2.1 time: 0.164183 Aug 05 14:27:06.036909 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 137/265] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:05 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:06.135776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:06.143642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-acbd47a3-866f-4ba7-8040-b28691d88f04 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.178803 Aug 05 14:27:06.144213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 129/266] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:05 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:07.049095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:07.049803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:07.057431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:07.057930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:07.058569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:07.059279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:07.059745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:07.060180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:07.166516 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:07.167359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:07.173667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:07.174159 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:07.174592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:07.175288 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:07.175742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:07.176162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:07.288852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:07.312311 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-952a701d-aca0-4a16-b93b-d11a2805395c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1509 microversion: 2.1 time: 0.267085 Aug 05 14:27:07.318381 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 138/267] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:07 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:07.366874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:07.375822 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0bc42159-eee3-4bc2-8dfa-e73e1ed60638 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.214008 Aug 05 14:27:07.376393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 130/268] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:07 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:08.340001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:08.341241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:08.347298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=48 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:08.348926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:08.349570 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:08.350023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:08.350727 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:08.351180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:08.351809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:08.397751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:08.399822 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:08.403021 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:08.404165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=8 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:08.408371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:08.409084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:08.409654 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:08.410506 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:08.411115 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:08.411690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:08.534957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:08.543812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8bd87ec3-1baa-453a-8987-9635f98552fd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1509 microversion: 2.1 time: 0.208426 Aug 05 14:27:08.549034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 139/269] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:08 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:08.600234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:08.611625 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-996d9894-8146-4358-b731-f9db59410f9d tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.217007 Aug 05 14:27:08.613699 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 131/270] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:08 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:09.571384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:09.572183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:09.578518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:09.579008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:09.579454 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:09.580146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:09.580633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:09.581063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:09.635724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:09.636331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:09.643078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:09.643562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:09.643992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:09.644709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:09.645162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:09.645583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:09.761614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:09.770553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a6441c97-c78c-48a2-8d39-f00597a2ebc2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1515 microversion: 2.1 time: 0.203540 Aug 05 14:27:09.771241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 140/271] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:09 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:09.826390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:09.835204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1094b8b4-bd19-4d79-be54-0cf80393bb7a tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.204235 Aug 05 14:27:09.840447 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 132/272] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:09 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:10.858866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:10.858866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:10.865006 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:10.865496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:10.866098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:10.866951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:10.869265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:10.870156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:11.005316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:11.013259 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6ea1d0ee-8a61-473f-90ef-9135bfdecb0c tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.159162 Aug 05 14:27:11.013824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 141/273] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:10 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:12.034360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:12.034979 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:12.041160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:12.041643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:12.042084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:12.042775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:12.043232 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:12.043645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:12.177021 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:12.185421 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-db26b785-ee76-4b6c-b9af-38ff7d7f3e68 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.154786 Aug 05 14:27:12.185999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 133/274] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:12 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:13.206323 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:13.206873 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:13.213379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:13.214132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:13.214569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:13.215256 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:13.215712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:13.216136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:13.341501 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:13.348883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0dcee83e-c73a-447d-9ec5-54e589509e2f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.146413 Aug 05 14:27:13.349451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 142/275] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:13 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:14.371145 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:14.371754 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:14.373857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:14.378494 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:14.379323 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:14.379770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:14.380493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:14.380948 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:14.381371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:14.510755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:14.518188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f95282a3-5e4f-421c-b840-81306270a0e5 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.152134 Aug 05 14:27:14.518753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 134/276] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:14 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:15.539358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:15.540644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:15.546875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:15.547362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:15.547805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:15.548520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:15.549010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:15.549443 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:15.684598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:15.692137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-47588a30-d1f2-42c6-9229-5835c8e6a1b4 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.156633 Aug 05 14:27:15.692837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 143/277] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:15 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:16.731300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:16.731993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:16.737952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:16.738433 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:16.738860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:16.739546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:16.739988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:16.743658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:16.818484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a182800b-a293-4d2d-9592-07bfa4856037 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'create', calling method: .version_select at 0x7fa75d54fca0>, body: {"keypair": {"name": "tempest-keypair-35680142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNmQa4AvQdSXG9aWDx8uaaF73u1RbFWtEmqoE94CjkNEMpsXnnwYnudKN3WnS3wuOm8DeLUSITZiTrZPQO5ILOAwSzCKDY57Nbgy0uSBJB8FUK+K3gYCA+1Dzc46STVCw=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:16.836910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-a182800b-a293-4d2d-9592-07bfa4856037 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:27:16.841322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-a182800b-a293-4d2d-9592-07bfa4856037 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for user b9d62fe4e6de4308a3a51be3e900625f and project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:27:16.894412 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:16.903018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8bd3f10d-0f33-4f2b-95b3-56a720104907 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.176275 Aug 05 14:27:16.904559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 135/278] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:16 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:16.965142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a182800b-a293-4d2d-9592-07bfa4856037 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.150937 Aug 05 14:27:16.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 144/279] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:27:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:17.532593 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-53781de2-b7d0-4f08-86a8-e91bd43480a7 req-6875edb8-ee1d-423f-8ce6-919790c5dae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a937e1a-c8d4-422a-a8bb-8ac896f262dc", "name": "network-vif-plugged", "status": "completed", "tag": "98ffda8e-29e3-4f27-9dbd-aa9a0ff73ff2"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:17.543677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-53781de2-b7d0-4f08-86a8-e91bd43480a7 req-6875edb8-ee1d-423f-8ce6-919790c5dae1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:17.544159 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-53781de2-b7d0-4f08-86a8-e91bd43480a7 req-6875edb8-ee1d-423f-8ce6-919790c5dae1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:17.544636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-53781de2-b7d0-4f08-86a8-e91bd43480a7 req-6875edb8-ee1d-423f-8ce6-919790c5dae1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:17.556018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-53781de2-b7d0-4f08-86a8-e91bd43480a7 req-6875edb8-ee1d-423f-8ce6-919790c5dae1 service nova] Creating event network-vif-plugged:98ffda8e-29e3-4f27-9dbd-aa9a0ff73ff2 for instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc on hv-cinder-80295 Aug 05 14:27:17.561442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-53781de2-b7d0-4f08-86a8-e91bd43480a7 req-6875edb8-ee1d-423f-8ce6-919790c5dae1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Aug 05 14:27:17.562053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 136/280] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:17.929436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:17.931343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:17.938440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:17.939013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:17.939521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:17.940289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:17.940847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:17.941355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:18.093457 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:18.101218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-43a8a01b-87f0-426c-bda9-177bcc6721ad tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.180999 Aug 05 14:27:18.101781 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 145/281] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:17 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:19.123060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:19.123857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:19.130064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:19.130572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:19.130999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:19.131680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:19.132126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:19.132568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:19.344053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:19.351677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-59af4cd0-a204-42a8-baf6-567c787a6003 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1315 microversion: 2.1 time: 0.232962 Aug 05 14:27:19.352999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 137/282] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:19 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:19.635648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-840080322", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01b7a00e-6b5a-4e1c-b9ad-35ae3b9e3f0e"}], "security_groups": [{"name": "tempest-securitygroup--192718582"}], "key_name": "tempest-keypair-35680142", "user_data": "}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:19.738575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] validate_networks() for [('01b7a00e-6b5a-4e1c-b9ad-35ae3b9e3f0e', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:27:20.126385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:27:20.126812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:27:20.127285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:27:20.127695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:27:20.128106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:27:20.137322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:20.137865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:20.138299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:20.139022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:20.139478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:20.139900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:20.157165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:27:20.161418 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Getting quotas for user b9d62fe4e6de4308a3a51be3e900625f and project 8725df4ddc2b4ec8accc5b0bd7b39a49. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:27:20.177595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:27:20.177595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:27:20.359152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4697fbfc-b9ba-4de0-8146-36a5b6f8f390 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.728449 Aug 05 14:27:20.359806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 146/283] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:27:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:27:20.371343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-920cd9cb-5dce-4aa0-a4a4-974877994ec7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:20.372127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-920cd9cb-5dce-4aa0-a4a4-974877994ec7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:20.377702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:20.378319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:20.387389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:20.388053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:20.388612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:20.389727 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:20.390531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:20.390872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:20.432535 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-920cd9cb-5dce-4aa0-a4a4-974877994ec7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:20.448664 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-920cd9cb-5dce-4aa0-a4a4-974877994ec7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1243 microversion: 2.1 time: 0.081653 Aug 05 14:27:20.450364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 138/284] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:20 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:20.614347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:20.627346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2062029c-8c56-400f-b469-0a64d1bb7c1f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1464 microversion: 2.1 time: 0.255718 Aug 05 14:27:20.627923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 147/285] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:20 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:20.675418 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:20.675913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:20.682011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:20.682434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:20.682867 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:20.683548 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:20.684000 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:20.684479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:20.854997 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:27:21.123099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4bc0c67f-7271-43b2-b2c4-aeb12017b72f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 204 len: 0 microversion: 2.1 time: 0.451495 Aug 05 14:27:21.123694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 139/286] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:27:20 2022] DELETE /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:27:21.131851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:21.132490 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:21.139172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:21.139661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:21.140214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:21.140934 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:21.141449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:21.141875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:21.278728 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:21.287268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a7cd4419-9434-4e55-9d78-32212e3ed975 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1470 microversion: 2.1 time: 0.159220 Aug 05 14:27:21.287840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 148/287] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:21 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:21.473764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:21.473764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:21.477266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:21.477743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:21.478173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:21.479129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:21.479490 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:21.479908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:21.547664 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:21.555333 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e5bb447a-c413-4518-bc99-50669d2ba2aa tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1247 microversion: 2.1 time: 0.088678 Aug 05 14:27:21.558015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 140/288] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:21 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:22.311101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:22.311723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:22.320878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:22.321376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:22.321819 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:22.323242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:22.324240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:22.324905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:22.575782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:22.576389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:22.582461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:22.583184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:22.583624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:22.584321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:22.584883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:22.594088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:22.595713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:22.604206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-890611fb-151c-40f9-aca7-696773ddab39 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1470 microversion: 2.1 time: 0.297891 Aug 05 14:27:22.604810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 149/289] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:22 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:22.651130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:22.658582 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a0d9e182-7387-4384-b85e-8f4357b85833 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1247 microversion: 2.1 time: 0.086739 Aug 05 14:27:22.659130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 141/290] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:22 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:23.625047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:23.625672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:23.633592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:23.633592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:23.633592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:23.634008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:23.634568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:23.635165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:23.679650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:23.680256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:23.687071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:23.687556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:23.687987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:23.688692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:23.689140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:23.689559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:23.761812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:23.769820 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b4a3b364-0a92-4833-88ea-4e6d689f7741 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1295 microversion: 2.1 time: 0.093921 Aug 05 14:27:23.779086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 142/291] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:23 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:23.792930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:23.802185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-117cd576-bb40-4f12-8896-dcf51d32f51f tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1470 microversion: 2.1 time: 0.180922 Aug 05 14:27:23.802747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 150/292] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:23 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:24.389098 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-a50dd107-1170-4bf6-aa59-ebf1963a6a13 req-eadff1cf-ee05-43f2-aec2-be8a46824ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a937e1a-c8d4-422a-a8bb-8ac896f262dc", "name": "network-vif-deleted", "tag": "98ffda8e-29e3-4f27-9dbd-aa9a0ff73ff2"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:24.399356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-a50dd107-1170-4bf6-aa59-ebf1963a6a13 req-eadff1cf-ee05-43f2-aec2-be8a46824ebf service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:24.400030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-a50dd107-1170-4bf6-aa59-ebf1963a6a13 req-eadff1cf-ee05-43f2-aec2-be8a46824ebf service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:24.400595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-a50dd107-1170-4bf6-aa59-ebf1963a6a13 req-eadff1cf-ee05-43f2-aec2-be8a46824ebf service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:24.405067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:24.413463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-a50dd107-1170-4bf6-aa59-ebf1963a6a13 req-eadff1cf-ee05-43f2-aec2-be8a46824ebf service nova] Creating event network-vif-deleted:98ffda8e-29e3-4f27-9dbd-aa9a0ff73ff2 for instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc on hv-cinder-80295 Aug 05 14:27:24.419239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-a50dd107-1170-4bf6-aa59-ebf1963a6a13 req-eadff1cf-ee05-43f2-aec2-be8a46824ebf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035636 Aug 05 14:27:24.448113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 143/293] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:24.791692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:24.792388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:24.799466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:24.800341 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:24.802796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:24.803525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:24.803990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:24.804444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:24.828296 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:24.830015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:24.836603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:24.837195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:24.838585 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:24.839457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:24.839912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:24.840573 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:24.873803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:24.874296 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:24.874810 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:24.875587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:24.875747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lazy-loading 'fault' on Instance uuid 9a937e1a-c8d4-422a-a8bb-8ac896f262dc {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:27:24.883400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8c19df7a-7f20-4a8b-9cfd-6ddd49f46a46 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1301 microversion: 2.1 time: 0.095692 Aug 05 14:27:24.884024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 151/294] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:24 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:24.933858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487d7e4081414c2193cb01ff0a202a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33905000a2f64751b88bbff67918d252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:24.941483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-82841586-ddec-4ccf-b071-326203f8ffff tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 200 len: 1305 microversion: 2.1 time: 0.121762 Aug 05 14:27:24.942103 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 144/295] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:24 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:27:25.906637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:25.907817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:25.915347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:25.916779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:25.917807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:25.918541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:25.919012 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:25.919440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:25.923716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:25.970879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:25.971493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] [instance: 9a937e1a-c8d4-422a-a8bb-8ac896f262dc] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:25.979912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:25.980677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:25.981360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:25.982261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:25.982989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:25.984473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:26.004750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] HTTP exception thrown: Instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc could not be found. Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Request method failure captured: Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc HTTP/1.1 Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Siuw5lnoBTSpodKZ3UBmyI-3Ah_PqjgoIsyZ_lIjZJynsdckQnqJwkbHFXLWgTWgdzjaLJk1yTHNfJWgSdQqkcBfjY2BrTf0VeHFbPDYozqhHCkzgT5PBc_iIpuFxPi8nAbl0ukqV9rdp54E2MDI3b7Igm1GFFO26j_PlGyitn1nRc Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 33905000a2f64751b88bbff67918d252 Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesNegativeTest-1093278883 Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:27:26.007502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33905000a2f64751b88bbff67918d252", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33905000a2f64751b88bbff67918d252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33905000a2f64751b88bbff67918d252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33905000a2f64751b88bbff67918d252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesNegativeTest-1093278883 Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 33905000a2f64751b88bbff67918d252 Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesNegativeTest-1093278883 Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesNegativeTest-1093278883-project Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 487d7e4081414c2193cb01ff0a202a6b Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesNegativeTest-1093278883-project Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc could not be found. Aug 05 14:27:26.008836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '9a937e1a-c8d4-422a-a8bb-8ac896f262dc'} Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc could not be found. Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:27:26.009642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc could not be found. Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc could not be found. Aug 05 14:27:26.011016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:27:26.012129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] Returning 404 to user: Instance 9a937e1a-c8d4-422a-a8bb-8ac896f262dc could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:27:26.012129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b9863a56-24a5-4a2f-9b8b-d2740b6545e2 tempest-VolumesNegativeTest-1093278883 tempest-VolumesNegativeTest-1093278883-project] 10.222.0.26 "GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc" status: 404 len: 111 microversion: 2.1 time: 0.044638 Aug 05 14:27:26.012129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 145/296] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:25 2022] GET /compute/v2.1/servers/9a937e1a-c8d4-422a-a8bb-8ac896f262dc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:27:26.150598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:26.158829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3bae5391-39d3-4558-965a-e6dd7ef996dd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.256634 Aug 05 14:27:26.172194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 152/297] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:25 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:26.436973 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-6321c6f7-0749-4746-a4bc-3b67245dd6a6 req-750825e8-3a68-42d6-a9d2-7a55841a6c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1b02bb-3a27-4800-8db5-13accab2125e", "tag": "8450e1f6-6d1a-4979-ad7e-10276a4c2679"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:26.448639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-6321c6f7-0749-4746-a4bc-3b67245dd6a6 req-750825e8-3a68-42d6-a9d2-7a55841a6c21 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:26.455817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-6321c6f7-0749-4746-a4bc-3b67245dd6a6 req-750825e8-3a68-42d6-a9d2-7a55841a6c21 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:26.455817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-6321c6f7-0749-4746-a4bc-3b67245dd6a6 req-750825e8-3a68-42d6-a9d2-7a55841a6c21 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:26.464949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-6321c6f7-0749-4746-a4bc-3b67245dd6a6 req-750825e8-3a68-42d6-a9d2-7a55841a6c21 service nova] Creating event network-changed:8450e1f6-6d1a-4979-ad7e-10276a4c2679 for instance fc1b02bb-3a27-4800-8db5-13accab2125e on hv-cinder-80295 Aug 05 14:27:26.469704 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-6321c6f7-0749-4746-a4bc-3b67245dd6a6 req-750825e8-3a68-42d6-a9d2-7a55841a6c21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Aug 05 14:27:26.470455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 146/298] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:27.182034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:27.182959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:27.190139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:27.190642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:27.191088 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:27.191884 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:27.192432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:27.197712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:27.329052 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:27.336773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b7f6aeb8-a6d5-4611-a1ef-757dc43684ab tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.159530 Aug 05 14:27:27.337342 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 153/299] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:27 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:28.359310 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:28.360002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:28.366051 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:28.366531 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:28.366963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:28.367692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:28.368143 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:28.369218 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:28.511809 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:28.523705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1b8ab8d0-ead0-4b33-896e-d53de9c70dec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.168749 Aug 05 14:27:28.524531 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 147/300] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:28 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:29.548023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:29.548697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:29.555325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:29.555811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:29.556253 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:29.557087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:29.557544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:29.557971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:29.703106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:29.710918 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d67300bf-b359-4951-b30e-8d8afe36ce26 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.166709 Aug 05 14:27:29.711046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 154/301] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:29 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:30.731971 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:30.732614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:30.734665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:30.739350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:30.739827 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:30.740256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:30.740961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:30.741407 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:30.741874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:30.876792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:30.885195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-82328a17-702c-4c86-abc7-2dca5da97c8f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.156910 Aug 05 14:27:30.885783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 148/302] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:30 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:31.917977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:31.918696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:31.920625 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:31.929673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=10 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:31.929673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:31.929673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:31.929673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:31.930175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:31.930175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:31.930175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:32.060772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:32.068059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d2e53fb0-b32e-48a3-aee4-7336028dee8e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.154697 Aug 05 14:27:32.068726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 155/303] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:31 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:33.090414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:33.091084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:33.097476 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:33.106599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:33.106599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:33.106599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:33.106599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:33.107197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:33.231805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:33.240282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d8573407-91ba-4d4c-bf9d-7a86acc046e1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.154832 Aug 05 14:27:33.240976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 149/304] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:33 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:34.261482 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:34.262091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:34.268934 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:34.269420 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:34.269860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:34.270553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:34.271009 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:34.271435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:34.401066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:34.408797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-aec39193-9e7e-470e-8cb8-c6c2ddbb30b4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.151873 Aug 05 14:27:34.409406 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 156/305] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:34 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:35.430488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:35.431527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:35.437522 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:35.438007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:35.438441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:35.439139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:35.439585 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:35.440020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:35.570940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:35.578459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dbcbc46a-c24f-4d0d-b5e5-7cfcb9b4fe5c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.151968 Aug 05 14:27:35.579020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 150/306] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:35 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:36.599279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:36.599978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:36.607239 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:36.607726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:36.608164 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:36.608877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:36.609335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:36.609762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:36.957024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:36.965698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fc1c4c25-8bad-4eb5-b8cc-b70e81ad0d68 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.370213 Aug 05 14:27:36.966277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 157/307] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:36 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:37.986952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:37.987557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:37.993510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:37.995127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:37.995127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:37.995665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:37.996127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:37.996580 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:38.122007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:38.129758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-15e32b1a-08c7-437d-837e-551665c81323 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.146665 Aug 05 14:27:38.134102 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 151/308] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:37 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:39.153917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:39.154498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:39.160793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:39.161276 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:39.161709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:39.162392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:39.162850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:39.163272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:39.308488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:39.318034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-150ac59d-cb27-4c35-8ab5-2f8d4403b562 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.168876 Aug 05 14:27:39.318601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 158/309] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:39 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:40.339887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:40.343702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:40.361695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:40.361695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:40.361695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:40.361695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:40.362077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:40.362077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:40.488263 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:40.497286 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d1cd48f4-b485-4d20-9458-2dc6aaf748ec tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.161448 Aug 05 14:27:40.498291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 152/310] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:40 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:41.518423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:41.519064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:41.521574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:41.527872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:41.528860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:41.529360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:41.534897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:41.534897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:41.534897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:41.662338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:41.670685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2aec5025-d245-475b-96c7-16bfe134ea7a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.156082 Aug 05 14:27:41.671246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 159/311] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:41 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:42.690983 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:42.691573 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:42.698244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:42.698873 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:42.699311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:42.699991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:42.700468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:42.700893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:42.832387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:42.839981 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b9390050-7aef-4bbb-995a-6f4690c41b3e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.152825 Aug 05 14:27:42.840561 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 153/312] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:42 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:43.861072 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:43.861685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:43.868003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:43.868516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:43.868976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:43.870021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:43.870480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:43.870909 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:44.000716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:44.008086 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-459f09ac-b1c5-4a01-bc84-ed72dcdb7791 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.151169 Aug 05 14:27:44.008743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 160/313] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:43 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:44.883027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-0cad13c5-2d5c-4e17-a627-f18b3a6718f5 req-5a8e2628-e60c-4913-994b-116b1f6c6d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1b02bb-3a27-4800-8db5-13accab2125e", "name": "network-vif-plugged", "status": "completed", "tag": "8450e1f6-6d1a-4979-ad7e-10276a4c2679"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:44.893090 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-0cad13c5-2d5c-4e17-a627-f18b3a6718f5 req-5a8e2628-e60c-4913-994b-116b1f6c6d46 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:44.893475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-0cad13c5-2d5c-4e17-a627-f18b3a6718f5 req-5a8e2628-e60c-4913-994b-116b1f6c6d46 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:44.893907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-0cad13c5-2d5c-4e17-a627-f18b3a6718f5 req-5a8e2628-e60c-4913-994b-116b1f6c6d46 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:44.906283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-0cad13c5-2d5c-4e17-a627-f18b3a6718f5 req-5a8e2628-e60c-4913-994b-116b1f6c6d46 service nova] Creating event network-vif-plugged:8450e1f6-6d1a-4979-ad7e-10276a4c2679 for instance fc1b02bb-3a27-4800-8db5-13accab2125e on hv-cinder-80295 Aug 05 14:27:44.915071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-0cad13c5-2d5c-4e17-a627-f18b3a6718f5 req-5a8e2628-e60c-4913-994b-116b1f6c6d46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036067 Aug 05 14:27:44.916470 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 154/314] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:45.034104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:45.034788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:45.041639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:45.042218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:45.042847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:45.043613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:45.044076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:45.044821 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:45.186788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:45.195234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-41a37dfe-630d-4928-af6c-ac1e5dd2e7ac tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.167997 Aug 05 14:27:45.196025 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 161/315] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:45 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:46.217857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:46.218636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:46.224879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:46.225352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:46.225910 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:46.226664 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:46.227220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:46.227710 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:46.364386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:46.374429 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7aab911a-cdb6-4e75-bc76-50ad0ea7c30e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.160709 Aug 05 14:27:46.374895 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 155/316] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:46 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:47.396152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:47.396853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:47.403685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:47.404187 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:47.404661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:47.405403 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:47.405976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:47.406405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:47.695135 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:47.703803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-70de77c9-7b0c-40f3-bdfc-1a7f3d95c270 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1368 microversion: 2.1 time: 0.312329 Aug 05 14:27:47.704171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 162/317] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:47 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:48.726887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:48.727564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:48.731824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:27:48.740719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:48.741736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:48.742187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:48.742975 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:48.743443 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:48.743879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:48.892846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:27:48.900788 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5e694654-cd39-48e1-ab07-7d4dd7bf8375 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1561 microversion: 2.1 time: 0.177526 Aug 05 14:27:48.901398 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 156/318] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:27:48 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:27:48.922473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:27:48.922983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:27:48.929321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:48.929805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:48.930242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:48.930935 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:48.931904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:48.932484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:49.015709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e2a1cd96-a752-4d4b-98fd-877c688bf932 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097153 Aug 05 14:27:49.016316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 163/319] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:27:48 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:27:50.244443 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-aa14544c-23e6-46ab-ba0d-0d8c9b57cc62 req-cb938eff-d5bc-44bf-b807-323683c4f891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1b02bb-3a27-4800-8db5-13accab2125e", "tag": "8450e1f6-6d1a-4979-ad7e-10276a4c2679"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:27:50.256117 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-aa14544c-23e6-46ab-ba0d-0d8c9b57cc62 req-cb938eff-d5bc-44bf-b807-323683c4f891 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:27:50.267652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-aa14544c-23e6-46ab-ba0d-0d8c9b57cc62 req-cb938eff-d5bc-44bf-b807-323683c4f891 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:27:50.267652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-aa14544c-23e6-46ab-ba0d-0d8c9b57cc62 req-cb938eff-d5bc-44bf-b807-323683c4f891 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:27:50.282717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-aa14544c-23e6-46ab-ba0d-0d8c9b57cc62 req-cb938eff-d5bc-44bf-b807-323683c4f891 service nova] Creating event network-changed:8450e1f6-6d1a-4979-ad7e-10276a4c2679 for instance fc1b02bb-3a27-4800-8db5-13accab2125e on hv-cinder-80295 Aug 05 14:27:50.290373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-aa14544c-23e6-46ab-ba0d-0d8c9b57cc62 req-cb938eff-d5bc-44bf-b807-323683c4f891 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049571 Aug 05 14:27:50.296257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 157/320] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:28:05.006662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=9 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:05.009710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=68 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:05.214343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ea3f48c0-9c19-4c5b-98a1-f87dbbb7e824 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Action: 'create', calling method: .version_select at 0x7fa75d3fa310>, body: {"keypair": {"name": "tempest-TestShelveInstance-29136839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg2EsOyJJSk1YIenFGCdNRT8XXH2wzQnjF4m0la+4eB1/V81caBqJq6sgmRGAeg54//d0i8PAsNwm/QNage3js/L/LquWpa5E8A3RyXM6okRpRZe2puHFWK9ZdBZM2pTg=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:05.232850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-ea3f48c0-9c19-4c5b-98a1-f87dbbb7e824 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Getting quotas for project 4717d08ca01041088bd4b95f00d7b5ef. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:28:05.237035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-ea3f48c0-9c19-4c5b-98a1-f87dbbb7e824 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Getting quotas for user 33b2cb4c04f6495bbb5ff171df953ef0 and project 4717d08ca01041088bd4b95f00d7b5ef. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:28:05.345594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ea3f48c0-9c19-4c5b-98a1-f87dbbb7e824 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.340075 Aug 05 14:28:05.346212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 164/321] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:28:05 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:28:35.035503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:35.036112 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:35.038774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=70 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:35.043976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:35.044472 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:35.044905 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:35.045578 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:35.046025 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:35.046481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:35.070599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-672e7262-764e-4bc3-a670-4d1f4780c9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/ips" status: 200 len: 150 microversion: 2.20 time: 0.040285 Aug 05 14:28:35.071155 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 158/322] 10.222.0.26 () {60 vars in 1289 bytes} [Fri Aug 5 14:28:35 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:28:37.724801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=4 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:37.725496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:37.729684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:37.730177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:37.736539 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:37.737028 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:37.737498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:37.738219 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:37.738680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:37.739109 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:37.762833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-96acc4a4-accb-44de-8dd2-4944752aeff7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/ips" status: 200 len: 146 microversion: 2.1 time: 0.039527 Aug 05 14:28:37.763420 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 165/323] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:28:37 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:28:38.428317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:38.428856 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:38.434865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:38.435347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:38.435780 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:38.436491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:38.436945 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:38.437368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:38.459823 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lazy-loading 'flavor' on Instance uuid 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:28:38.877888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-49485483-a6f2-4169-8e32-7702f7bdea37 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/action" status: 202 len: 0 microversion: 2.20 time: 0.453251 Aug 05 14:28:38.878673 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 159/324] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Aug 5 14:28:38 2022] POST /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 05 14:28:38.887097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:38.888284 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:38.896529 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:38.897045 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:38.897472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:38.898179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:38.898635 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:38.899066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:39.037330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:39.045203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:39.046702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:39.047881 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9f0cec91-561e-4e4c-98ee-a57fda7bbd22 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.164650 Aug 05 14:28:39.048657 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 166/325] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:38 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:40.071921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:40.072671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:40.079712 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:40.080203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:40.080670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:40.081371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:40.082041 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:40.082466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:40.222831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:40.230905 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:40.232433 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:40.233598 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-edbf0b82-960e-43f2-a5f9-9f4f82230e4e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.166209 Aug 05 14:28:40.234156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 160/326] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:40 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:41.258214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:41.258821 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:41.265380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:41.265871 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:41.266328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:41.267739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:41.268245 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:41.268714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:41.439697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:41.448171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:41.449712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:41.451696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8430f65a-7fe8-40fe-a7af-49ad89c9b450 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.198578 Aug 05 14:28:41.451696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 167/327] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:41 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:42.263852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56eed8c-3e66-42a1-bcc1-abc12a2176fb"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:42.266463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:42.273981 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:42.274467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:42.275109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:42.275809 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:42.276438 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:42.277033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:42.474469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:42.475005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:42.481284 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:42.481774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:42.482210 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:42.482992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:42.483444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:42.483878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:42.640011 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:42.649015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:42.650528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:42.651690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a613843c-661f-48a1-80fc-62ab9272175a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.181264 Aug 05 14:28:42.652313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 168/328] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:42 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:28:43.169534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-be871b15-da62-423f-9005-8180765f9ebd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912848 Aug 05 14:28:43.170146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 161/329] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:28:42 2022] POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-volume_attachments => generated 194 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:28:43.675973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:43.676819 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:43.683138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:43.683621 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:43.684048 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:43.684809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:43.685290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:43.685712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:43.817847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:43.826236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:43.827804 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:43.829019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-47f1398c-8f51-4d91-8503-0a7bbc3fb6ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.158150 Aug 05 14:28:43.829606 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 169/330] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:43 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:44.854638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:44.855549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:44.861761 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:44.863079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:44.863618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:44.864527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:44.865018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:44.865504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:45.000450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:45.009551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:45.011062 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:45.012221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-82f8ec93-dd45-4c2f-bc78-ebf9f3e86f73 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.162465 Aug 05 14:28:45.013008 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 162/331] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:44 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:45.815504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-537865161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-29136839", "security_groups": [{"name": "tempest-secgroup-smoke-1410397758"}], "networks": [{"uuid": "02628c22-8f93-4a58-a17b-2738612b0566"}], "block_device_mapping_v2": [{"uuid": "5b1a0241-53f1-4bbf-8fd1-ada3be14ea9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:45.935153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] validate_networks() for [('02628c22-8f93-4a58-a17b-2738612b0566', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:28:46.036720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:46.037266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:46.043780 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:46.044259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:46.044994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:46.045396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:46.045846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:46.046267 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:46.260775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:46.274682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:46.276617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:46.278507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8546bf9c-39dc-4380-b293-fe3060f54089 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.247265 Aug 05 14:28:46.279126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 163/332] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:46 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:28:46.378641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:28:46.379075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:28:46.379574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:28:46.379997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:28:46.380430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:28:46.389209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:46.389694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:46.390137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:46.390866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:46.391327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:46.391851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:46.408508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Getting quotas for project 4717d08ca01041088bd4b95f00d7b5ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:28:46.412986 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Getting quotas for user 33b2cb4c04f6495bbb5ff171df953ef0 and project 4717d08ca01041088bd4b95f00d7b5ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:28:46.473667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:28:46.475704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b1a0241-53f1-4bbf-8fd1-ada3be14ea9c',volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:28:46.869159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0c471975-324e-45fe-b76b-5249ef9b56fb tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058051 Aug 05 14:28:46.870461 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 170/333] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:28:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:28:46.882437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0f2ce95c-1e6c-4df5-b79a-c13ae922d4e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:46.883358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0f2ce95c-1e6c-4df5-b79a-c13ae922d4e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:46.943459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0f2ce95c-1e6c-4df5-b79a-c13ae922d4e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:46.950092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0f2ce95c-1e6c-4df5-b79a-c13ae922d4e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1086 microversion: 2.1 time: 0.072298 Aug 05 14:28:46.950657 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 164/334] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:46 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1086 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:28:47.304287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:47.304860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:47.311156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:47.311643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:47.312298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:47.313031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:47.313489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:47.314064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:47.447226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:47.457058 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:47.458562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:47.459782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-199c51c4-a37a-4f75-ba43-22fb2eaf9ad1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.160493 Aug 05 14:28:47.460342 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 171/335] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:47 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:47.970311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:47.970925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:47.979037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:47.979549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:47.979985 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:47.980713 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:47.981172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:47.981597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:48.042530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:48.051205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2b514fb9-feba-4301-8eb5-fcdde74154a5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1136 microversion: 2.1 time: 0.084767 Aug 05 14:28:48.051766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 165/336] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:47 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:48.482480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:48.483098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:48.489730 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:48.490303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:48.491133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:48.491844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:48.492309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:48.492790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:48.646925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:48.656806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:48.658892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:48.660528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-da027d75-bf35-47c3-b740-80da1e41b359 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.181897 Aug 05 14:28:48.661317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 172/337] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:48 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:49.073247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:49.073785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:49.080163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:49.085165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:49.085165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:49.085165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:49.085165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:49.085549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:49.146326 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:49.153823 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f2d3c0e6-e8e8-4dde-a121-bcd03f965f9d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1184 microversion: 2.1 time: 0.084535 Aug 05 14:28:49.154392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 166/338] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:49 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1184 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:49.685306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:49.687040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:49.694364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:49.695102 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:49.695756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:49.696828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:49.697487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:49.698108 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:49.857459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:49.865283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:49.866841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:49.867926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-80bdfc77-2925-4f32-9568-9072dce4f97b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.187890 Aug 05 14:28:49.868506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 173/339] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:49 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:50.176160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:50.177162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:50.183986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:50.184648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:50.185184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:50.186185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:50.186845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:50.187444 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:50.254629 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:50.262477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a271a7c3-c5fa-4bcf-ac9a-f4fa8cfb6753 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1202 microversion: 2.1 time: 0.091186 Aug 05 14:28:50.263036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 167/340] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:50 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:50.890911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:50.891525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:50.898579 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:50.899597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:50.900206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:50.901146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:50.901769 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:50.902207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:51.069442 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:51.079003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:51.080686 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:51.082026 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-98b0dbe4-3888-49dc-b357-4253b46f31fd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.194917 Aug 05 14:28:51.082574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 174/341] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:50 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:51.287199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:51.288505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:51.295860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:51.296999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:51.297892 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:51.298669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:51.299125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:51.299546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:51.435072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:51.443283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d3f825e7-a39e-44c1-bc8c-f7ce6b75a960 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1270 microversion: 2.1 time: 0.162548 Aug 05 14:28:51.446497 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 168/342] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:51 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:52.106521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:52.107248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:52.114777 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.115444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.115978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.116955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.117713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.123808 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.130665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-e3af590f-1049-4fe2-9703-8e4f0368f5be req-9a5bff9d-8a9d-4efe-b073-b03da87e7b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:52.142377 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e3af590f-1049-4fe2-9703-8e4f0368f5be req-9a5bff9d-8a9d-4efe-b073-b03da87e7b66 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.143592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e3af590f-1049-4fe2-9703-8e4f0368f5be req-9a5bff9d-8a9d-4efe-b073-b03da87e7b66 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.145021 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e3af590f-1049-4fe2-9703-8e4f0368f5be req-9a5bff9d-8a9d-4efe-b073-b03da87e7b66 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.159346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-e3af590f-1049-4fe2-9703-8e4f0368f5be req-9a5bff9d-8a9d-4efe-b073-b03da87e7b66 service nova] Creating event network-changed:8b771fe9-cb75-4a40-83f5-e824ba468b93 for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe on hv-cinder-80295 Aug 05 14:28:52.169064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-e3af590f-1049-4fe2-9703-8e4f0368f5be req-9a5bff9d-8a9d-4efe-b073-b03da87e7b66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043709 Aug 05 14:28:52.169987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 169/343] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:28:52.261293 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8263b4c7-4efc-4253-8fc7-02a7f7c4c305 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:52.270184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8263b4c7-4efc-4253-8fc7-02a7f7c4c305 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.270857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8263b4c7-4efc-4253-8fc7-02a7f7c4c305 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.271435 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8263b4c7-4efc-4253-8fc7-02a7f7c4c305 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.342345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8263b4c7-4efc-4253-8fc7-02a7f7c4c305 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Going to try to stop instance {{(pid=118052) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 14:28:52.345569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:52.356090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:52.358063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:52.359923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9eba2c4e-645e-42c5-8695-534c505da5ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1743 microversion: 2.20 time: 0.257247 Aug 05 14:28:52.361253 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 175/344] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:52 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:52.464219 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:52.473778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:52.473778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.473778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.473778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.474264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.474264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.474264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.490723 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8263b4c7-4efc-4253-8fc7-02a7f7c4c305 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action" status: 202 len: 0 microversion: 2.1 time: 0.233047 Aug 05 14:28:52.491871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 170/345] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:28:52 2022] POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:28:52.500748 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:52.501769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:52.509449 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.509939 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.510673 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.511924 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:52.512387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:52.514784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:52.696319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:52.742446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-613bd01e-5803-4ffe-a7ea-8a4d7c49bc84 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1270 microversion: 2.1 time: 0.282144 Aug 05 14:28:52.744059 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:52.749723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 176/346] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:52 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:28:52.754118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a0031c59-0656-4d9a-b921-396c8cd47bee tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.257213 Aug 05 14:28:52.756602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 171/347] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:52 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:53.383897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:53.384773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:53.391863 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:53.392351 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:53.392818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:53.393513 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:53.393966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:53.395161 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:53.538008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:53.546044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:53.547555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:53.548774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d4ec2fee-c9ab-441b-866e-519fdcfaa8fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1743 microversion: 2.20 time: 0.169327 Aug 05 14:28:53.549326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 177/348] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:53 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:53.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:53.771826 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:53.776940 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:53.777854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:53.778429 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:53.778923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:53.779378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:53.780235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:53.781020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:53.781438 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:53.784213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:53.785470 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:53.785915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:53.786326 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:53.787688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:53.788174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:53.788642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:53.993567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:53.996571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:54.001072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dd8de4e7-f2b3-495c-85f7-46a8ee9c9051 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1270 microversion: 2.1 time: 0.234926 Aug 05 14:28:54.001692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 172/349] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:53 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:54.004358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ae6658c2-b649-4e8b-9e71-2a0a95cac83e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.231359 Aug 05 14:28:54.004938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 178/350] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:53 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:54.572662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:54.573262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:54.579557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:54.580030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:54.580717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:54.581401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:54.581849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:54.582264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:54.712786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:54.721099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:54.722819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:54.724177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e4e40655-20ac-4d67-89dc-2e035ff20982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1743 microversion: 2.20 time: 0.155956 Aug 05 14:28:54.724814 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 173/351] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:54 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:54.998131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-6c4f36f7-eb31-47c4-b94d-dae19d5b0d6f req-87554909-54e8-42fc-942c-7e4ae642da6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "name": "network-vif-plugged", "status": "completed", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:54.998131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-6c4f36f7-eb31-47c4-b94d-dae19d5b0d6f req-87554909-54e8-42fc-942c-7e4ae642da6e service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:54.998131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-6c4f36f7-eb31-47c4-b94d-dae19d5b0d6f req-87554909-54e8-42fc-942c-7e4ae642da6e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:54.998131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-6c4f36f7-eb31-47c4-b94d-dae19d5b0d6f req-87554909-54e8-42fc-942c-7e4ae642da6e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.008647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-6c4f36f7-eb31-47c4-b94d-dae19d5b0d6f req-87554909-54e8-42fc-942c-7e4ae642da6e service nova] Creating event network-vif-plugged:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:28:55.014379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-6c4f36f7-eb31-47c4-b94d-dae19d5b0d6f req-87554909-54e8-42fc-942c-7e4ae642da6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Aug 05 14:28:55.015331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 179/352] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:28:55.023838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:55.024479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:55.026271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:55.026271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:55.032962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:55.033469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:55.033892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.034005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:55.034424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:55.034623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:55.034864 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.035039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:55.035464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.035570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:55.036005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:55.036528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.237361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:55.242074 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:55.245986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-47e3f70a-f11f-46c2-a35e-8f7d4612652c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.227581 Aug 05 14:28:55.247121 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 174/353] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:55 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:55.250831 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7b7d1551-6773-4377-9bd9-63edfa522363 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.229650 Aug 05 14:28:55.251377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 180/354] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:55 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:28:55.747783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:55.748469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:55.754280 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:55.755725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:55.756167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.756900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:55.757351 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:55.757772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:55.898487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:55.906531 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:55.908115 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:55.909184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ca8d7fc0-2a7e-46e9-aba0-d9af45efbd58 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1743 microversion: 2.20 time: 0.165921 Aug 05 14:28:55.909738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 175/355] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:55 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:56.050406 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2023643556", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "networks": [{"uuid": "2b311a85-6a72-40b8-b38e-650c49fd2616"}]}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:28:56.107630 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] validate_networks() for [('2b311a85-6a72-40b8-b38e-650c49fd2616', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:28:56.267306 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:56.268309 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:56.275078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.275564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.276823 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.276823 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.277344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.277777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.399220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:56.420076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:56.490693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:56.511436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d04de7fe-e1a1-424c-bad8-c4cebafd9527 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.235053 Aug 05 14:28:56.511436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 176/356] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:56 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:28:56.511436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:56.511436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:56.511436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.511962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.511962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.511962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.511962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.512283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.539712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:28:56.540140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:28:56.540658 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:28:56.541151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:28:56.541575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:28:56.550459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.550949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.551583 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.552331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.552840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.553278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.570681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Getting quotas for project 5e50310a4bcd4dd5acde809956702d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:28:56.574591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Getting quotas for user cee6d9ed0c344584b8bf2fbe3c4178bf and project 5e50310a4bcd4dd5acde809956702d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:28:56.587282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:28:56.589721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:28:56.647796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:56.655923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-54f56164-1e05-4160-823d-e56b135255fb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.156030 Aug 05 14:28:56.656626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 177/357] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:56 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:56.689174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-80e14eb8-6fbc-4e9b-a385-8ae4ab5d96c3 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642676 Aug 05 14:28:56.689908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 181/358] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:28:56.701177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c143adca-0574-4253-91bf-81d9eb76432d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:56.701782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c143adca-0574-4253-91bf-81d9eb76432d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:56.755114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c143adca-0574-4253-91bf-81d9eb76432d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:56.762415 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c143adca-0574-4253-91bf-81d9eb76432d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1219 microversion: 2.1 time: 0.065090 Aug 05 14:28:56.763066 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 178/359] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:56 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:56.933483 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:56.934207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:56.940227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.940813 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.941315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:56.942741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:56.943277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:56.943768 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.084902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:57.094378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:57.103518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:57.105000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b50511d6-28b4-4a97-8e37-01f5507cfa7a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1743 microversion: 2.20 time: 0.175518 Aug 05 14:28:57.105900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 182/360] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:56 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:57.519729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:57.520606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:57.527426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:57.527903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:57.532396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.532396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:57.532396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:57.532396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.663096 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:57.670695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2ab256cb-06a6-45fd-9731-e1a4c89ab693 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.155478 Aug 05 14:28:57.671198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 179/361] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:57 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:57.678195 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:57.679034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:57.685108 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:57.685597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:57.686031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.686737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:57.687231 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:57.687654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.782812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:57.783427 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:57.790138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:57.790584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:57.791019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.791719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:57.792172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:57.792625 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:57.826430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:57.833919 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:28:57.847306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-47f07b5d-f3cd-409e-8d82-1cc2e7320878 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.173229 Aug 05 14:28:57.848204 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 183/362] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:57 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:57.862358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:57.870742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d1fe083f-b1f7-4afd-bf2a-b0e89c1d87c1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1223 microversion: 2.1 time: 0.091571 Aug 05 14:28:57.871347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 180/363] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:57 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:28:58.128801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:58.129438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:58.137184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.137679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.138113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.138805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.139366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.139790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.278068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:58.286276 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:58.290771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:58.290771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c036111d-4c0c-49a8-b2eb-b7e46ee67f88 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1743 microversion: 2.20 time: 0.164043 Aug 05 14:28:58.290771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 184/364] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:58 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:58.691888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:58.692670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:58.699391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.700337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.700968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.701981 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.702593 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.703176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.839374 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:58.847676 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cca0763a-1899-41ca-ae7f-dc8e416cd8ae tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.160090 Aug 05 14:28:58.848785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 181/365] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:58 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:58.873852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:58.874465 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:58.881028 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.881512 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.881952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.882640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.883100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.883607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.891427 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:58.892034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:58.898821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.900720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.900720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.900720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:58.901136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:58.901849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:58.992738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:59.002463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-fcfb7155-db80-4e4d-8055-c91886a0dfab tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1271 microversion: 2.1 time: 0.114855 Aug 05 14:28:59.003371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 182/366] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:58 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:28:59.058348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:59.066326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ed0022b1-16bc-4903-af05-1fa23caa84ce tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.196362 Aug 05 14:28:59.066950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 185/367] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:58 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:28:59.318662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:59.319821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:59.331820 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:59.332320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:59.333601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:59.334721 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:59.335189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:59.335759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:59.479736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:59.488261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:59.490230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:28:59.491604 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b87b0bb3-a721-4961-bc0a-51569d630941 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.182336 Aug 05 14:28:59.492171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 183/368] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:28:59 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:28:59.872376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:28:59.873039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:28:59.885070 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:59.885754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:59.886378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:28:59.888109 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:28:59.888769 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:28:59.889358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.027803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:00.028449 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:00.046527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:00.046962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:00.048054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.048838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:00.061728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:00.063587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.274471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:00.283670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bd589833-61e7-4409-b020-2fbad6e6afcc tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1277 microversion: 2.1 time: 0.261298 Aug 05 14:29:00.285715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 184/369] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:00 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:00.295316 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:00.302306 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:00.317923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:00.319611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:00.320393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.321374 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:00.321985 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:00.322572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.340118 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:00.360234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9d5669ce-0732-45c5-b5f3-a49890b805f4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.493967 Aug 05 14:29:00.366355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 186/370] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:28:59 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:00.512783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:00.517494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:00.519763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:00.524543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9170deed-1a11-47b8-a19b-4cf32fce4f95 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.237444 Aug 05 14:29:00.545412 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 185/371] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:00 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:00.545535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:00.545535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:00.545535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.545535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:00.545868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:00.545868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:00.743456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:00.752565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:00.755420 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:00.756652 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7a7b2305-01a4-45d9-b90d-bab6392e1a02 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.245658 Aug 05 14:29:00.757383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 187/372] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:00 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:01.313828 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:01.314670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:01.321933 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.322425 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.322893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.323855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.324489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.325108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.386366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:01.386969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:01.393854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.394674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.395998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.397022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.397696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.398327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.542312 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:01.559747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f92d2293-e564-4984-8bd1-d5ba3e8e76e7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.250262 Aug 05 14:29:01.562426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 186/373] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:01 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:01.567223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:01.568279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:01.575877 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.576736 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.577396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.578277 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.578748 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.579178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.651714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:01.665176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-aae6757c-8bff-4652-a8c5-d425df723b11 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.282475 Aug 05 14:29:01.679417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 188/374] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:01 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:01.760101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:01.768977 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2e4da521-32ef-43a0-845c-97972c9fb5f1 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.205194 Aug 05 14:29:01.769849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 187/375] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:01 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:01.791708 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:01.792553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:01.799279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.799793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.800267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.801097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:01.803687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:01.803687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:01.981456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:02.002042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:02.002042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:02.002042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-aaef5d38-5daf-4c8f-9b60-7836074f8c7b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.207484 Aug 05 14:29:02.002400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 189/376] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:01 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:02.581614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:02.582265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:02.589744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.590440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.591054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.591930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.592630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.593224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.686368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:02.687872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:02.696263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.697064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.697684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.698565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.699175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.699762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.809908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:02.823623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-14f4e210-110e-4ac2-b71a-7e8288a6e7ed tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.245585 Aug 05 14:29:02.837533 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 188/377] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:02 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:02.845814 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:02.846742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:02.856239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.864952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.864952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.864952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.864952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.865658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.937626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:02.947024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3c4c1e6a-5946-4789-855f-ee669a31a958 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.264545 Aug 05 14:29:02.947573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 190/378] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:02 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:02.957829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-15790fdb-5073-403c-a2d0-b313501245cf req-12f56e71-81bd-4367-8062-11c3729536b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d7eedb-e88e-448f-ab53-86cd9203b566", "tag": "6237f1d2-d321-4dc4-88ac-012b853e5511"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:02.968754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-15790fdb-5073-403c-a2d0-b313501245cf req-12f56e71-81bd-4367-8062-11c3729536b3 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:02.969524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-15790fdb-5073-403c-a2d0-b313501245cf req-12f56e71-81bd-4367-8062-11c3729536b3 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:02.969968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-15790fdb-5073-403c-a2d0-b313501245cf req-12f56e71-81bd-4367-8062-11c3729536b3 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:02.981251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-15790fdb-5073-403c-a2d0-b313501245cf req-12f56e71-81bd-4367-8062-11c3729536b3 service nova] Creating event network-changed:6237f1d2-d321-4dc4-88ac-012b853e5511 for instance 79d7eedb-e88e-448f-ab53-86cd9203b566 on hv-cinder-80295 Aug 05 14:29:02.986881 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-15790fdb-5073-403c-a2d0-b313501245cf req-12f56e71-81bd-4367-8062-11c3729536b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037436 Aug 05 14:29:02.987673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 191/379] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:29:03.019797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:03.021782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:03.028598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:03.028885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:03.029248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:03.029954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:03.030409 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:03.030833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:03.055430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:03.059449 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:03.071613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-36debb8b-4f22-49db-bd0b-37ca80f28557 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.232577 Aug 05 14:29:03.072623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 189/380] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:02 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:03.186762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:03.195759 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:03.197307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:03.198482 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-60f87b71-8ac1-4641-9912-b101af85aef3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.183242 Aug 05 14:29:03.199275 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 192/381] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:03 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:29:03.854740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:03.855427 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:03.865898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:03.868890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:03.873750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:03.874745 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:03.881284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:03.882089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:03.969847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:03.970449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:03.977869 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:03.978628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:03.979253 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:03.980038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:03.980706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:03.981320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:04.100871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:04.112061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a49e9a7f-18d7-478e-ae72-ead71a62ddba tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.264708 Aug 05 14:29:04.114281 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 190/382] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:03 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:04.137868 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:04.138570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:04.159176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:04.164588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:04.164588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:04.164588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:04.164588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:04.164974 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:04.222766 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:04.232080 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d239fb40-113e-4875-a3b5-46364545d23d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.266513 Aug 05 14:29:04.232810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 193/383] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:03 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:04.244670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:04.245775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:04.257053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:04.257951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:04.258773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:04.259751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:04.261031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:04.261664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:04.374912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:04.385514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6ba7313b-a404-4f83-b785-81d5a4389def tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.251443 Aug 05 14:29:04.386095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 191/384] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:04 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:04.453110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:04.462712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:04.464557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:04.465729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b4b9441e-995e-46b7-b3ca-f41e629c5be7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.231632 Aug 05 14:29:04.466282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 194/385] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:04 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:05.137676 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:05.138668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:05.141808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=76 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:05.148521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.156048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.156048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.156048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.156048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.156610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.259250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:05.262552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:05.276022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.277169 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.277833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.279430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.280637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.281091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.318391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:05.329729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e5ebcd2d-0227-4dee-95f3-2ab138a8bdf7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.199521 Aug 05 14:29:05.344366 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 192/386] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:05 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:05.409190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:05.409972 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:05.425763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.426562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.427040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.427951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.428491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.428927 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.466278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:05.478850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fe712344-daf7-41a0-9eae-95f1b3c180f1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.230378 Aug 05 14:29:05.480400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 195/387] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:05 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:05.491065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:05.492802 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:05.499621 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.500489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.501177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.502318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:05.502952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:05.503552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:05.694665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:05.703984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b1f1e891-d596-4b2b-921c-105f834ff13c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.300751 Aug 05 14:29:05.704950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 193/388] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:05 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:05.724854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:05.733699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:05.735408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:05.736611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c5be32f4-748b-4566-91a3-47e0d39a0f79 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.251175 Aug 05 14:29:05.737478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 196/389] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:05 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:06.352300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:06.352972 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:06.359711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.360273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.360667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.361361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.361819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.362245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.503194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:06.503824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:06.508355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:06.510723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.511210 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.511645 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.512337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.512820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.513244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.519999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4cb27850-49ae-4b7e-a35e-d18a86b2a16f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.168365 Aug 05 14:29:06.529926 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 194/390] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:06 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:06.560889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:06.581503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:06.650136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:06.658335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f739c1c9-a8b2-4066-9a37-0b855322670f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.158926 Aug 05 14:29:06.658896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 197/391] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:06 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:06.727445 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:06.728232 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:06.734858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.735439 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.736104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.737193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.737763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.738284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.759304 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:06.760607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:06.760926 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=4 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:06.767358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.773069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.773069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.773069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:06.773069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:06.773451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:06.965970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:06.970402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:06.978789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-95739470-2188-495e-a526-1cd98e5f7c7e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.255810 Aug 05 14:29:06.979500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:06.982304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 195/392] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:06 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:06.984959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:06.990796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0421a18f-b757-4307-bd35-58c3e8ea70db tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.231250 Aug 05 14:29:06.990796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 198/393] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:06 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:29:07.537162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:07.537877 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:07.544639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:07.545130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:07.545565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:07.546264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:07.546722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:07.547147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:07.679475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:07.680916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:07.694826 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:07.697900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:07.701540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:07.702227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:07.702835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:07.703786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:07.704523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:07.708949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:07.709989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-21b80ae8-b249-456a-a56a-920aea7a24c9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.177068 Aug 05 14:29:07.720203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 196/394] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:07 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:07.870835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:07.879392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d725e1c3-c978-41b5-9549-9699b70f4575 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.204176 Aug 05 14:29:07.880551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 199/395] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:07 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:08.013138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:08.014070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:08.018108 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:08.018758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:08.022868 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.023663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.024333 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.025402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.026093 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.026286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.026809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.027119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.027283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.027989 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.028490 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.028930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.236946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:08.246539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b5fa6528-afe1-4652-a065-d95de4a73fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.240339 Aug 05 14:29:08.247474 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 197/396] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:08 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:08.271168 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:08.280355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:08.281900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:08.283830 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-582879af-2842-436e-8990-2a64ab3defc8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.269094 Aug 05 14:29:08.286973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 200/397] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:08 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:29:08.733343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:08.734131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:08.741947 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.742520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.743054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.745682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.746251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.746763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.901368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:08.901961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:08.925212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.926063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.926853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.928296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:08.929003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:08.930222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:08.951798 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:09.064730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:09.074154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-39e271a6-043a-4f25-ac9c-9b2b1c6bcce5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.344690 Aug 05 14:29:09.075007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:08 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:09.184699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:09.196893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-63cc3e99-bb6a-470c-b434-3c7efe2948ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.299220 Aug 05 14:29:09.197763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 201/399] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:08 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:09.269167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:09.269782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:09.278308 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:09.279138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:09.279866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:09.280922 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:09.281577 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:09.282064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:09.306128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:09.306739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:09.315280 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:09.315697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:09.316140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:09.316867 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:09.317329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:09.318980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:09.527111 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:09.548961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:09.549495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5662a135-3d2e-437e-8d90-90014fe646d5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.283879 Aug 05 14:29:09.550522 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 199/400] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:09 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:09.561797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:09.563316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:09.564558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-326216aa-cbdb-4597-88cd-cde83371d40c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.262473 Aug 05 14:29:09.565139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 202/401] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:09 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:10.096596 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:10.097721 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:10.104104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.104627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.105069 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.105763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.106215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.106639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.218337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:10.219136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:10.225679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.226178 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.226667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.227417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.227943 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.228404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.256700 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:10.264225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-54bb9697-8257-4221-988d-14c6f636644e tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.171587 Aug 05 14:29:10.265163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 200/402] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:10 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:10.381533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:10.394391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-39816b78-c480-49c0-b6c8-34ab3847df56 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.178183 Aug 05 14:29:10.411748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 203/403] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:10 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:10.470265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-b7856929-ebf8-42e0-bfb1-83906a4af279 req-5d640483-d214-4b40-bea8-1214d5834df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "name": "network-vif-plugged", "status": "completed", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:10.483126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-b7856929-ebf8-42e0-bfb1-83906a4af279 req-5d640483-d214-4b40-bea8-1214d5834df1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.483727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-b7856929-ebf8-42e0-bfb1-83906a4af279 req-5d640483-d214-4b40-bea8-1214d5834df1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.485532 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-b7856929-ebf8-42e0-bfb1-83906a4af279 req-5d640483-d214-4b40-bea8-1214d5834df1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.497011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-b7856929-ebf8-42e0-bfb1-83906a4af279 req-5d640483-d214-4b40-bea8-1214d5834df1 service nova] Creating event network-vif-plugged:8b771fe9-cb75-4a40-83f5-e824ba468b93 for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe on hv-cinder-80295 Aug 05 14:29:10.504403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-b7856929-ebf8-42e0-bfb1-83906a4af279 req-5d640483-d214-4b40-bea8-1214d5834df1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037960 Aug 05 14:29:10.505755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 201/404] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:29:10.572689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:10.573314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:10.582081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.582081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.588381 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:10.593482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:10.593634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.593634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.596030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.596699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.602930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.603411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.604026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.604928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:10.605534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:10.606120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:10.831503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:10.845512 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:10.850648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:10.852481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:10.853855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-57667f90-2a0a-4803-a91f-4fc6270d8686 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.270228 Aug 05 14:29:10.855695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-68cd2a85-adac-4176-babc-a366dad68701 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1724 microversion: 2.1 time: 0.287853 Aug 05 14:29:10.856575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 204/405] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:10 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:10.869111 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 202/406] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:10 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:11.287583 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:11.288129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:11.294694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.295528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.295648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.296311 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.296762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.297402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.418954 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:11.420142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:11.427292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.428033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.428656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.432947 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.433522 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.433957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.457324 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:11.467719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-68ee611b-8e6f-4512-bda9-299dd0d42d4d tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.185101 Aug 05 14:29:11.468296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:11 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:11.579458 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:11.587899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-465ba66d-e7ae-4ee7-b2df-d504ce171232 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.172793 Aug 05 14:29:11.588493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 203/408] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:11 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:11.878211 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:11.878551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:11.878775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:11.879203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:11.885629 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.886042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.886213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.886473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.886714 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.887133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.887237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.887611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.887884 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:11.888033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:11.888331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:11.888786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.084880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.090162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.093218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-01a9e147-b7ce-4521-8efd-c7ca146ade47 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1701 microversion: 2.1 time: 0.219228 Aug 05 14:29:12.099799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 206/409] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:11 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1701 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:12.099968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.100620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.101842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e3a2ef22-f3b9-4a83-914f-66b0b03b1e14 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1738 microversion: 2.20 time: 0.227303 Aug 05 14:29:12.102398 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 204/410] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:11 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:29:12.114901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a7946064-5e0b-4790-8207-2e4e0f124a31 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:12.121033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7946064-5e0b-4790-8207-2e4e0f124a31 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.121517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7946064-5e0b-4790-8207-2e4e0f124a31 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.121950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7946064-5e0b-4790-8207-2e4e0f124a31 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.182001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a7946064-5e0b-4790-8207-2e4e0f124a31 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Going to try to start instance {{(pid=118053) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 14:29:12.318704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a7946064-5e0b-4790-8207-2e4e0f124a31 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action" status: 202 len: 0 microversion: 2.1 time: 0.207211 Aug 05 14:29:12.319393 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 207/411] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:29:12 2022] POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:29:12.327481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:12.328084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:12.334638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.335115 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.335546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.336227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.336711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.337386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.471982 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.479921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-09358b4c-24db-4be2-ba41-cc7b39c7b506 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1710 microversion: 2.1 time: 0.156391 Aug 05 14:29:12.480508 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 205/412] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:12 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:12.489498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:12.490478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:12.497193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.497679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.498122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.498814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.499273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.499774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.609027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:12.611825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:12.616300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.616824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.617261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.617960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:12.618451 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:12.619154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:12.644669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.652553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bc47588a-7c4f-451b-8cac-2d57be7d53c6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.167351 Aug 05 14:29:12.653474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 208/413] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:12 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:12.760934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:12.768287 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dc4bffcf-736e-4827-9e86-b6221f9997b0 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.163192 Aug 05 14:29:12.768881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 206/414] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:12 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:13.124356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:13.125000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:13.131415 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.131901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.132337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.133057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.133518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.133946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.299215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:13.309795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:13.311611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:13.313183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-29590907-8647-431d-ba66-3ad11ed67858 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1720 microversion: 2.20 time: 0.192312 Aug 05 14:29:13.313959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 209/415] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:13 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:13.501540 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:13.502147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:13.509306 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.509786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.510220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.510910 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.511356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.511770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.516510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:13.659176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:13.669241 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4b739d46-b98a-43fc-8af5-eb628f0220ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1710 microversion: 2.1 time: 0.170665 Aug 05 14:29:13.670219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 207/416] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:13 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:13.681614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:13.681614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:13.691725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.692355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.693035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.693848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.694457 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.695170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.790633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:13.791241 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:13.797282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.797763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.798188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.798873 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:13.799320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:13.799759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:13.831058 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:13.841136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bfa61dd3-e01e-4d5a-b73f-1f08957d43f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.168240 Aug 05 14:29:13.855610 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 210/417] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:13 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:13.939732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:13.948843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a70a61f8-147f-4f9f-8ef1-07f35814e0e3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1258 microversion: 2.1 time: 0.163255 Aug 05 14:29:13.949440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 208/418] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:13 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:14.337535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:14.338126 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:14.344548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.344976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.345415 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.346104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.346556 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.346983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.490555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:14.499024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:14.500598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:14.504937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-06f7b120-7cfc-4c58-97f8-1bae8fb26204 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1720 microversion: 2.20 time: 0.168818 Aug 05 14:29:14.504937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 211/419] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:14 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:14.700490 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:14.701132 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:14.707543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.708018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.708491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.709258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.709715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.710136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.842946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:14.850866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7bad10da-8b7f-4d32-96cf-9b574267844c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1710 microversion: 2.1 time: 0.154249 Aug 05 14:29:14.851431 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 209/420] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:14 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:14.862709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:14.863319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:14.869201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.869678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.870110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.870789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.871240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.871661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.970640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:14.971334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:14.977706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.978191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.978622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:14.979315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:14.979757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:14.980359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:15.004806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:15.013659 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6c0ab3e8-a907-457e-a535-cd4151cb1ad1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.154643 Aug 05 14:29:15.027428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 212/421] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:14 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:15.114461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:15.121977 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-75162666-8987-4d28-8836-a09cbec95dd4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1442 microversion: 2.1 time: 0.155293 Aug 05 14:29:15.122550 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 210/422] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:14 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:15.141989 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:15.142607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:15.149380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:15.149866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:15.150307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:15.151000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:15.151459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:15.151888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:15.284978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:15.292786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-42388d2a-9be2-477b-abcf-fc9dbb9012b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1442 microversion: 2.1 time: 0.154565 Aug 05 14:29:15.293348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 213/423] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:15 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:15.526099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:15.527250 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:15.532656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:15.533137 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:15.533568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:15.534297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:15.534749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:15.535164 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:15.741072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:15.749259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:15.751049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:15.752237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f787feb3-b2c7-4309-9fe1-fb5c4d443a96 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1720 microversion: 2.20 time: 0.230166 Aug 05 14:29:15.752890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 211/424] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:15 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:29:15.871292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:15.871911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:15.877997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:15.878483 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:15.878919 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:15.879613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:15.880067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:15.880542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:16.035221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:16.035773 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:16.045963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:16.046476 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:16.046900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:16.047595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:16.048049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:16.048494 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:16.054226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:16.062401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f840e3a8-34e9-48c3-a91f-e54ba2cbc2c6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1710 microversion: 2.1 time: 0.195161 Aug 05 14:29:16.062976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 214/425] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:15 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:16.261005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:16.269417 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1c00561c-0744-436f-8062-27e08c32a7c7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.238139 Aug 05 14:29:16.270774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 212/426] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:16 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:16.381108 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-48a8a4ec-0384-4913-97e7-ad05f039cce5 req-0f666d60-755d-4b82-9e97-1279e3c80821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d7eedb-e88e-448f-ab53-86cd9203b566", "name": "network-vif-plugged", "status": "completed", "tag": "6237f1d2-d321-4dc4-88ac-012b853e5511"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:16.391320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-48a8a4ec-0384-4913-97e7-ad05f039cce5 req-0f666d60-755d-4b82-9e97-1279e3c80821 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:16.391890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-48a8a4ec-0384-4913-97e7-ad05f039cce5 req-0f666d60-755d-4b82-9e97-1279e3c80821 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:16.392387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-48a8a4ec-0384-4913-97e7-ad05f039cce5 req-0f666d60-755d-4b82-9e97-1279e3c80821 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:16.404394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-48a8a4ec-0384-4913-97e7-ad05f039cce5 req-0f666d60-755d-4b82-9e97-1279e3c80821 service nova] Creating event network-vif-plugged:6237f1d2-d321-4dc4-88ac-012b853e5511 for instance 79d7eedb-e88e-448f-ab53-86cd9203b566 on hv-cinder-80295 Aug 05 14:29:16.409271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-48a8a4ec-0384-4913-97e7-ad05f039cce5 req-0f666d60-755d-4b82-9e97-1279e3c80821 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032651 Aug 05 14:29:16.409900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 215/427] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:29:16.776707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:16.778492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:16.788210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:16.789033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:16.790319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:16.791195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:16.791831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:16.792448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:17.009862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:17.017903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:17.019393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:17.020560 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7a858bf7-31b6-476d-90cd-3551bcd7a3d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1720 microversion: 2.20 time: 0.249115 Aug 05 14:29:17.021237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 213/428] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:16 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:17.085886 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:17.086595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:17.093026 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:17.093524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:17.093967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:17.094687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:17.095151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:17.095578 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:17.291723 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:17.292500 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:17.306022 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:17.306587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:17.307029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:17.307735 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:17.308193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:17.308646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:17.624154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:17.631492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:17.632688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-343f11cd-0e2f-44a3-9948-f0b92cdf7718 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1710 microversion: 2.1 time: 0.552138 Aug 05 14:29:17.633404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 216/429] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:17 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1710 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:17.639233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2ae4c1f8-dccf-4fab-92a7-841956578835 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.351960 Aug 05 14:29:17.646725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 214/430] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:17 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:18.019713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-b42df43f-8100-45b5-9f9a-4e87785b4371 req-1aaba6ce-c1c2-4650-910b-b6966f9c4e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:18.029752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b42df43f-8100-45b5-9f9a-4e87785b4371 req-1aaba6ce-c1c2-4650-910b-b6966f9c4e0e service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.036203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b42df43f-8100-45b5-9f9a-4e87785b4371 req-1aaba6ce-c1c2-4650-910b-b6966f9c4e0e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.036203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b42df43f-8100-45b5-9f9a-4e87785b4371 req-1aaba6ce-c1c2-4650-910b-b6966f9c4e0e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.043095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-b42df43f-8100-45b5-9f9a-4e87785b4371 req-1aaba6ce-c1c2-4650-910b-b6966f9c4e0e service nova] Creating event network-changed:8b771fe9-cb75-4a40-83f5-e824ba468b93 for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe on hv-cinder-80295 Aug 05 14:29:18.044255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:18.045392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:18.048349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-b42df43f-8100-45b5-9f9a-4e87785b4371 req-1aaba6ce-c1c2-4650-910b-b6966f9c4e0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032344 Aug 05 14:29:18.049171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 217/431] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:29:18.052244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.052957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.053406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.054112 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.054571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.054998 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.189510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:18.197574 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:18.199107 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:18.200259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-96b1ed32-347d-4e97-9ba9-3810b26d1fcb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1723 microversion: 2.20 time: 0.160131 Aug 05 14:29:18.200903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 215/432] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:18 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:29:18.224341 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e94bb26d-438f-4666-8ff0-47ba63275f9e"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:18.227389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:18.234123 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.234613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.235055 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.235757 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.236254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.236713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.240591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:18.429935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-4dad3690-3038-4656-8b77-5240d0ecb283 req-48a245cc-e0e4-4fdb-a6ca-5880894f2838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "name": "network-vif-unplugged", "status": "completed", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:18.435152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-4dad3690-3038-4656-8b77-5240d0ecb283 req-48a245cc-e0e4-4fdb-a6ca-5880894f2838 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.435683 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-4dad3690-3038-4656-8b77-5240d0ecb283 req-48a245cc-e0e4-4fdb-a6ca-5880894f2838 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.436122 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-4dad3690-3038-4656-8b77-5240d0ecb283 req-48a245cc-e0e4-4fdb-a6ca-5880894f2838 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.447874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-4dad3690-3038-4656-8b77-5240d0ecb283 req-48a245cc-e0e4-4fdb-a6ca-5880894f2838 service nova] Creating event network-vif-unplugged:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:29:18.453028 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-4dad3690-3038-4656-8b77-5240d0ecb283 req-48a245cc-e0e4-4fdb-a6ca-5880894f2838 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032012 Aug 05 14:29:18.453709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 216/433] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:29:18.654962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:18.655804 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:18.662266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.662754 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.663192 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.663890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.664343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.664811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.800506 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:18.810310 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2b17cf24-cf61-40d7-a963-f7c98b950e32 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1714 microversion: 2.1 time: 0.159792 Aug 05 14:29:18.811257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 217/434] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:18 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:18.818906 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:18.818906 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:18.824594 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.825415 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.825552 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.826602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:18.826837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:18.827314 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:18.973084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:18.982744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-964a384b-102d-4332-97ac-75e39f191267 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1319 microversion: 2.1 time: 0.170238 Aug 05 14:29:18.983670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 218/435] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:18 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:29:19.350114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eabacdc6-e039-4417-8d27-40a68cd8c575 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.129429 Aug 05 14:29:19.351434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 218/436] 10.222.0.26 () {62 vars in 1364 bytes} [Fri Aug 5 14:29:18 2022] POST /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments => generated 188 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:29:19.480099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:19.480711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:19.487514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:19.489781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:19.489781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:19.489781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:19.489781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:19.490170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:19.537571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118052) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 14:29:19.763446 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ea98900d-a850-4a2b-81ea-8c78124aaea4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/action" status: 202 len: 0 microversion: 2.20 time: 0.287252 Aug 05 14:29:19.764468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 219/437] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Aug 5 14:29:19 2022] POST /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:29:19.773713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:19.774328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:19.780386 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:19.780906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:19.781346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:19.782081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:19.782540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:19.782969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:19.923798 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:19.944386 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:19.945972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:19.947141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9ab6be6d-bbf9-443a-96b4-d0ebe7a17818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1749 microversion: 2.20 time: 0.178505 Aug 05 14:29:19.947775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 219/438] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:19 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:20.004044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:20.004779 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:20.011555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:20.016332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:20.016332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:20.016332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:20.016332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:20.017521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:20.163631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:20.173658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-34852869-a427-487f-a551-07d0eeadfd08 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1508 microversion: 2.1 time: 0.173346 Aug 05 14:29:20.174422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 220/439] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:29:19 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:29:20.971971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:20.973268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:20.981345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:20.981855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:20.982300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:20.983223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:20.983872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:20.984314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:21.163033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:21.171528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:21.173064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:21.174223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-96db6edc-a592-40d6-b871-612d9bbb0b5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1749 microversion: 2.20 time: 0.206866 Aug 05 14:29:21.174826 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 220/440] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:20 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1749 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:22.197453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:22.197996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:22.204666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:22.205148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:22.205588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:22.206273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:22.206728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:22.207167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:22.340867 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:22.349401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:22.351500 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:22.352693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-836785cb-0094-4baa-80f7-b589c8c5f9f7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1751 microversion: 2.20 time: 0.159275 Aug 05 14:29:22.353247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 221/441] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:22 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:23.375792 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:23.376439 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:23.383864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:23.384347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:23.384838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:23.385515 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:23.385972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:23.386402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:23.521477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:23.534786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:23.536438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:23.538456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d1f19037-e866-46a2-955d-2be2ebf0a26c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1751 microversion: 2.20 time: 0.166003 Aug 05 14:29:23.539145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 221/442] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:23 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:24.562840 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:24.564245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:24.571481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:24.572044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:24.572507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:24.573202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:24.573644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:24.574056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:24.714797 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:24.723154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:24.724696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:24.725852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2f8ae49b-9ad2-48d7-9897-c1332d7e4c4f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.167578 Aug 05 14:29:24.726722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 222/443] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:24 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:25.748957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:25.749840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:25.757918 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:25.758414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:25.758861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:25.759577 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:25.760045 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:25.760500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:25.908034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:25.917534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:25.919057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:25.920222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c1dee48c-1771-417f-add8-aa03a47834d5 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.175180 Aug 05 14:29:25.920917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 222/444] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:25 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:26.943589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:26.944950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:26.951521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:26.951996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:26.952445 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:26.953239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:26.953686 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:26.954214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:26.972127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:27.107445 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:27.115705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:27.117344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:27.118482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-652e693e-f6d7-42f7-8b4e-4a79dcdbb1d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.178879 Aug 05 14:29:27.119034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 223/445] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:26 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:28.141954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:28.142561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:28.150917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:28.151410 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:28.151850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:28.152579 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:28.153040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:28.153466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:28.294279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:28.302859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:28.304377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:28.305563 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-78be3007-7c45-40af-a9e0-a0939485855b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.167646 Aug 05 14:29:28.306129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 223/446] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:28 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:29.329531 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:29.330268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:29.338546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:29.339037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:29.339539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:29.340317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:29.340813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:29.341267 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:29.486655 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:29.495370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:29.496920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:29.498081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ea8a294d-7ebf-44c2-b2e2-65d2264d2e59 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.173071 Aug 05 14:29:29.499016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 224/447] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:29 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:30.521424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:30.527312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:30.528663 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:30.529154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:30.529597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:30.530297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:30.530759 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:30.531193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:30.672020 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:30.681079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:30.682593 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:30.683747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6be30a0e-4758-4818-aee0-c48ef6e12d40 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.166269 Aug 05 14:29:30.684309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 224/448] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:30 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:31.706660 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:31.707240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:31.715230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:31.715715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:31.716148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:31.716883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:31.717332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:31.717749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:31.861302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:31.870386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:31.871857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:31.873089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2c8ae078-6654-44f0-8692-6ac50ef0e01d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.170481 Aug 05 14:29:31.873628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 225/449] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:31 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:32.895868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:32.896517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:32.903081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:32.903572 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:32.904013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:32.905067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:32.905383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:32.905612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:33.059370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:33.067691 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:33.069532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:33.070736 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-021317e7-a492-4cf7-862f-fc9fc714210b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.178798 Aug 05 14:29:33.071292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 225/450] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:32 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:34.094067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:34.094689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:34.101563 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:34.102040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:34.102495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:34.103256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:34.103707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:34.104134 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:34.236983 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:34.256290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:34.258644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:34.259824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c6780166-e553-485c-bb48-7ee2d15af96c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.169626 Aug 05 14:29:34.260382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 226/451] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:34 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:35.285684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:35.286282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:35.292706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:35.293184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:35.293613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:35.294325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:35.294776 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:35.295198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:35.437611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:35.447183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:35.448748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:35.449943 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-364445a9-742f-4182-9224-f9d8b15ea17b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.168116 Aug 05 14:29:35.450503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 226/452] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:35 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:36.473627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:36.475255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:36.483480 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:36.485060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:36.485818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:36.486413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:36.487466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:36.488119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:36.489012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:36.624828 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:36.634230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:36.635717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:36.636892 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2b294a1a-ee73-45fe-85f3-cb9fc42af72f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.168415 Aug 05 14:29:36.637446 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 227/453] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:36 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:37.660271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:37.660932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:37.667808 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:37.668286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:37.668749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:37.669428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:37.669878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:37.670298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:37.805141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:37.814222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:37.815751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:37.816965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c261ac5c-588e-409e-89cd-21d553007292 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.160569 Aug 05 14:29:37.817721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 227/454] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:37 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:38.842044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:38.842647 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:38.849150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:38.849617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:38.850045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:38.850728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:38.851170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:38.851640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:38.985373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:38.994388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:38.995877 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:38.997056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-923bb676-0674-4ad2-9126-5c2d23a482fc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159385 Aug 05 14:29:38.997621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 228/455] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:38 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:40.020184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:40.020832 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:40.024348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=57 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:40.029123 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:40.030266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:40.030765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:40.031467 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:40.031928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:40.032359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:40.162213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:40.170811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:40.172310 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:40.173739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8b4d540c-3206-45ab-8f5e-ca06cf0b54d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.157470 Aug 05 14:29:40.174301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 228/456] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:40 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:41.196740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:41.197290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:41.203611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:41.204088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:41.204543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:41.205227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:41.205680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:41.206120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:41.334144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:41.343306 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:41.344843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:41.345995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9c7c6678-2998-4c30-874d-579a6db9dc05 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153395 Aug 05 14:29:41.346831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 229/457] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:41 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:42.370309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:42.370997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:42.377514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:42.378002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:42.378505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:42.379115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:42.379574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:42.379998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:42.513044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:42.521738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:42.523254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:42.525120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-49473f11-9e41-49f9-b529-888717ec01e2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159382 Aug 05 14:29:42.525671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 229/458] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:42 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:43.548228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:43.548863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:43.555289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:43.555774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:43.556208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:43.556928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:43.557375 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:43.557799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:43.685394 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:43.693733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:43.695236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:43.696396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2da5fcfb-74f4-497c-9427-b7c4cb4b4b08 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.152076 Aug 05 14:29:43.697087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 230/459] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:43 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:44.719914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:44.720513 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:44.726937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:44.727425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:44.727876 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:44.729090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:44.729547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:44.729977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:44.864744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:44.873744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:44.875258 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:44.876483 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-edb4664e-c6e0-47d4-8251-202baabd3fa0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.160500 Aug 05 14:29:44.877044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 230/460] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:44 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:45.899061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:45.899665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:45.907524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:45.907991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:45.908436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:45.909110 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:45.909552 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:45.909983 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:46.045863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:46.054184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:46.055711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:46.057083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-56309940-14c1-41b7-b0ad-36fe450e3445 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.161718 Aug 05 14:29:46.057638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 231/461] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:45 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:47.080853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:47.081475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:47.087471 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:47.087960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:47.097924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:47.097924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:47.097924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:47.097924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:47.220855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:47.229144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:47.230650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:47.231797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8e6b5c5a-51d1-48b1-b7ba-88be8b708b6c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.155194 Aug 05 14:29:47.232354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 231/462] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:47 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:47.323944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9228ad84-71ba-4736-8087-0c4054e41f6c", "device": "/dev/sdb"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:47.326887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:47.338690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:47.338690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:47.338690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:47.338690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:47.339168 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:47.339168 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:48.166264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7dff3bf9-ece3-4a7c-88df-2ce56addd4fd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "POST /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847209 Aug 05 14:29:48.166942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 232/463] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:29:47 2022] POST /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:29:48.254945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:48.255586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:48.262085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:48.262569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:48.263015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:48.263699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:48.264205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:48.264667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:48.268696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:48.403073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:48.411581 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:48.413139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:48.414312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-762c9cbf-204e-4b24-a3ee-296f6bac4982 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.163400 Aug 05 14:29:48.414869 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 232/464] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:48 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:49.438711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:49.439401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:49.446087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:49.446561 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:49.447029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:49.447841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:49.448290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:49.448738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:49.464614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5399bdd-1d8e-4213-b4a6-dfcea23b5bad"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:49.467060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:49.473362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:49.473856 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:49.474297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:49.474998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:49.475570 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:49.476005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:49.582609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:49.592566 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:49.594101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:49.595255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-947305c1-dda5-45bb-a887-3ea3455009f0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.160773 Aug 05 14:29:49.595830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 233/465] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:49 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:50.212152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3732f9cf-2a12-46f5-88d4-646f3a797fe0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752019 Aug 05 14:29:50.212872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 233/466] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:29:49 2022] POST /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:29:50.618968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:50.620444 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:50.627911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:50.628385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:50.628833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:50.629502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:50.629943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:50.630356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:50.765205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:50.774263 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:50.776512 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:50.777728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-292fcca9-5629-4859-8700-0c5ba8ee8192 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.162589 Aug 05 14:29:50.778493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 234/467] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:50 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:51.801527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:51.802226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:51.808376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:51.808889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:51.809327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:51.810015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:51.810508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:51.810945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:51.940846 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:51.949358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:51.950869 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:51.952030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8c3a5d9b-7d6c-4e90-9fee-476bf0bafdf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.155314 Aug 05 14:29:51.952705 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 234/468] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:51 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:52.977502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:52.978159 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:52.985186 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:52.985664 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:52.986097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:52.986785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:52.987236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:52.987666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:53.117706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:53.126357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:53.127862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:53.129039 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4f83cf0f-871b-4d1c-8168-c68e0f02b757 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.155450 Aug 05 14:29:53.129599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 235/469] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:52 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:54.151912 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:54.152537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:54.158864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:54.159341 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:54.159775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:54.160473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:54.160925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:54.161345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:54.290137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:54.298792 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:54.300371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:54.301554 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2426a8b1-72ce-4d62-9067-decd3addcf0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.154290 Aug 05 14:29:54.302122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 235/470] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:54 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:55.324177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:55.324826 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:55.332000 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:55.332521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:55.332970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:55.333655 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:55.334136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:55.334556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:55.462534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:55.471420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:55.472957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:55.474118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-827c7253-d268-4d2a-9720-904fd3100ee0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153946 Aug 05 14:29:55.474692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 236/471] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:55 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:56.497217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:56.497947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:56.504124 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:56.504637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:56.505081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:56.505766 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:56.506215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:56.506700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:56.649464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:56.660534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:56.662329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:56.663784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-644442cc-98a5-43df-91ae-42efb2c7afd2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.170637 Aug 05 14:29:56.664450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 236/472] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:56 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:56.729302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-5fa0e375-5c15-4bf0-a9a6-0facdcb76b06 req-2b7ba0ea-d2ac-48be-b8b2-e48819cbd8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "name": "network-vif-plugged", "status": "completed", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:29:56.740858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-5fa0e375-5c15-4bf0-a9a6-0facdcb76b06 req-2b7ba0ea-d2ac-48be-b8b2-e48819cbd8c0 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:56.741368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-5fa0e375-5c15-4bf0-a9a6-0facdcb76b06 req-2b7ba0ea-d2ac-48be-b8b2-e48819cbd8c0 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:56.741800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-5fa0e375-5c15-4bf0-a9a6-0facdcb76b06 req-2b7ba0ea-d2ac-48be-b8b2-e48819cbd8c0 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:56.755167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-5fa0e375-5c15-4bf0-a9a6-0facdcb76b06 req-2b7ba0ea-d2ac-48be-b8b2-e48819cbd8c0 service nova] Creating event network-vif-plugged:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:29:56.760225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-5fa0e375-5c15-4bf0-a9a6-0facdcb76b06 req-2b7ba0ea-d2ac-48be-b8b2-e48819cbd8c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Aug 05 14:29:56.760870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 237/473] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:29:57.686892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:57.687504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:57.693831 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:57.694313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:57.694748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:57.695434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:57.695890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:57.696316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:57.824122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:57.833269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:57.834787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:57.835961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1c01f5d0-99b6-4f99-a08c-c3e077a4ec7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153593 Aug 05 14:29:57.836550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 237/474] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:57 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:29:58.860165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:29:58.860881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:29:58.866911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:58.867380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:58.867799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:58.868501 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:29:58.868945 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:29:58.869357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:29:58.871924 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:29:59.002547 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:59.010919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:59.012392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:29:59.014304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a8dd07cb-feca-4e3d-a474-29ecd68461ab tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159184 Aug 05 14:29:59.014866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 238/475] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:29:58 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:00.038455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:00.039008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:00.046552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:00.047064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:00.047510 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:00.048267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:00.048787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:00.049180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:00.205944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:00.214800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:00.216917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:00.218187 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6dd985ee-16b6-40de-a42d-c8aaaea82024 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.183856 Aug 05 14:30:00.218761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 238/476] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:00 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:01.240816 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:01.241423 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:01.248526 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:01.249008 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:01.249440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:01.250122 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:01.250573 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:01.250995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:01.379471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:01.387792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:01.389366 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:01.390515 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-278b5749-97a9-40cf-b8d0-10049e94bff2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153595 Aug 05 14:30:01.391072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 239/477] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:01 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:02.413053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:02.413744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:02.420768 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:02.423331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:02.423331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:02.423331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:02.423331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:02.423721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:02.555527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:02.564557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:02.566046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:02.567194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-535b02ce-151a-4ec6-9f5b-89de979dad9b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.158053 Aug 05 14:30:02.567752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 239/478] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:02 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:03.590113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:03.590719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:03.597261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:03.597743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:03.598175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:03.598859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:03.599311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:03.599731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:03.728088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:03.736604 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:03.738099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:03.739247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2fe8d48f-85e9-4ece-9d85-03e694c2af60 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153336 Aug 05 14:30:03.739813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 240/479] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:03 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:04.762690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:04.763345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:04.770065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:04.770550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:04.784157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:04.784157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:04.784157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:04.784157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:04.905716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:04.914252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:04.915758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:04.916999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1ac8c607-4fb6-4a6f-9227-8309bd533ba0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.158158 Aug 05 14:30:04.917542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 240/480] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:04 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:05.939944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:05.940588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:05.947214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:05.947689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:05.948125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:05.948842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:05.949293 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:05.949715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:06.077776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:06.086180 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:06.087709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:06.089102 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2cc0db21-0280-4fd5-8a62-e2d547bc39a1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153220 Aug 05 14:30:06.089661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 241/481] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:05 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:07.112308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:07.112988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:07.119289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:07.119768 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:07.120202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:07.121030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:07.121369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:07.121791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:07.256699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:07.265448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:07.266953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:07.268101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2306a798-530f-4303-a7de-039627ae2146 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159673 Aug 05 14:30:07.268706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 241/482] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:07 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:30:08.291131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:08.291927 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:08.294386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=30 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:08.300266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:08.300816 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:08.301249 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:08.301935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:08.302386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:08.302874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:08.435805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:08.444402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:08.447286 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:08.447286 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ea7b94de-342c-4baf-b8be-7299d10bbc8e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159856 Aug 05 14:30:08.447635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 242/483] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:08 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:30:09.376761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:09.379137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:09.385526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:09.386017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:09.386464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:09.387205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:09.387740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:09.388242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:09.411484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lazy-loading 'flavor' on Instance uuid fc1b02bb-3a27-4800-8db5-13accab2125e {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:30:09.470181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:09.470894 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:09.477597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:09.478078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:09.478509 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:09.479394 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:09.479849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:09.480270 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:09.615052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:09.623694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:09.625238 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:09.626396 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cdd10d4c-4de7-4b7f-b05f-a30f899c6ae9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1794 microversion: 2.20 time: 0.160336 Aug 05 14:30:09.626962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 243/484] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:30:09 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:30:09.749777 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0468273d-0ecb-4ebb-b413-9155820da729 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/action" status: 200 len: 32 microversion: 2.1 time: 0.377990 Aug 05 14:30:09.750426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 242/485] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:30:09 2022] POST /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/action => generated 32 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:30:09.759818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:09.760473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:09.766992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:09.768238 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:09.768727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:09.769428 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:09.769882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:09.770301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:09.902666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:09.911205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2a0763bf-35b2-49ee-beb8-bd1b4d0eb10e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.155321 Aug 05 14:30:09.911777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 244/486] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:09 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:10.934066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:10.934859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:10.938149 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=30 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:10.941950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:10.942431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:10.942902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:10.943588 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:10.944037 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:10.944478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:11.128059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:11.135834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8e12de12-582b-40d6-8422-10b7866dc84f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.206534 Aug 05 14:30:11.136395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 243/487] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:10 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:12.157577 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:12.158237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:12.164756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:12.165237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:12.165671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:12.166354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:12.166813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:12.167235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:12.303837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:12.314228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3b0d6749-306b-473f-927c-7ec8dfa14557 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.160574 Aug 05 14:30:12.314838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 245/488] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:12 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:13.335139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:13.335753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:13.342590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:13.343079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:13.343524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:13.344228 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:13.344721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:13.345155 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:13.475065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:13.483010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7d5241cc-8783-4c52-9719-7ffb92ced02e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.151825 Aug 05 14:30:13.484531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 244/489] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:13 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:14.504588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:14.505205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:14.511852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:14.512341 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:14.512817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:14.514106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:14.514563 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:14.514990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:14.650433 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:14.659305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4e3e292c-742b-4ea0-a696-9fd4082ecf7f tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.158564 Aug 05 14:30:14.659900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 246/490] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:14 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:15.681736 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:15.682272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:15.689414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:15.689902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:15.690344 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:15.691038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:15.691499 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:15.691925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:15.710285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:15.913380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:15.922090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2f3014aa-0a2b-4be9-beb8-cdaf2a8a6cb3 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.244259 Aug 05 14:30:15.922673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 245/491] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:15 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:16.944485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:16.945082 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:16.952448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:16.953064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:16.953487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:16.954213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:16.954669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:16.955092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:17.135975 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:17.144742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3d76fd58-0bdc-4442-bf35-9d45ac043fb8 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.204237 Aug 05 14:30:17.145307 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 247/492] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:16 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:18.166464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:18.167069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:18.174213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:18.174696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:18.175124 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:18.175838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:18.176295 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:18.176758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:18.315156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:18.324748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9f1946f9-4855-40eb-9d4b-dc493e851b41 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.161842 Aug 05 14:30:18.325323 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 246/493] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:18 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:18.960565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:18.960565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:18.966555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:18.967600 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:18.968034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:18.968756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:18.969208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:18.969622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:19.096808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lazy-loading 'services' on Instance uuid 79d7eedb-e88e-448f-ab53-86cd9203b566 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:30:19.348251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:19.348888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:19.353605 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-748597e7-3048-4924-abef-e0dcbbe14ed1 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566/os-volume_attachments/9228ad84-71ba-4736-8087-0c4054e41f6c" status: 202 len: 0 microversion: 2.1 time: 0.398182 Aug 05 14:30:19.354283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 248/494] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:30:18 2022] DELETE /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566/os-volume_attachments/9228ad84-71ba-4736-8087-0c4054e41f6c => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:30:19.355388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:19.356052 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:19.356525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:19.357230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:19.358320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:19.358990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:19.496199 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:19.505279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8cdad909-7f3c-4ea8-b4bd-a2c9239f09c1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.161184 Aug 05 14:30:19.505853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 247/495] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:19 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:20.528119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:20.528888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:20.535276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:20.535758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:20.536190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:20.536934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:20.537388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:20.537860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:20.673600 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:20.681441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-30d64839-46bf-4597-8530-a31dc44f676c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.158107 Aug 05 14:30:20.682003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 249/496] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:20 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:21.702613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:21.703838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:21.710271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:21.710747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:21.711176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:21.711855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:21.712306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:21.712749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:21.842170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:21.850272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-46dcb16d-fa82-40de-8318-c027c2e73459 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.151558 Aug 05 14:30:21.850836 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 248/497] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:21 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:22.596863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:22.597353 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:22.603699 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:22.604179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:22.604659 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:22.605345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:22.605798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:22.606233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:22.631521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:30:22.871127 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:22.871734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:22.878961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:22.879439 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:22.880124 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:22.880984 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:22.881508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:22.882096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:22.974633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0da56e81-71bb-4c32-a61d-39975b3ff010 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 204 len: 0 microversion: 2.1 time: 0.381375 Aug 05 14:30:22.975224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 250/498] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:30:22 2022] DELETE /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:30:22.983896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:22.985530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:22.991208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:22.991671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:22.992103 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:22.992831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:22.993274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:22.993821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:23.018041 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:23.027157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b6482c78-8c6f-48db-b5aa-3f9d8729f6eb tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.159925 Aug 05 14:30:23.041998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 249/499] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:22 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:23.132167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:23.139951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dd299630-3417-4362-af96-44119ea53f60 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1514 microversion: 2.1 time: 0.160244 Aug 05 14:30:23.141148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 251/500] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:22 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:24.050120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:24.050638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:24.057023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:24.057505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:24.057953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:24.058640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:24.059100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:24.059527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:24.161247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:24.161963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:24.172634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:24.173221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:24.173985 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:24.174756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:24.175297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:24.175781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:24.192660 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:24.192933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:24.201392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e2218fe4-0804-4cc2-a263-fccae3986dd1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.155911 Aug 05 14:30:24.204350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 250/501] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:24 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:24.313271 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:24.320846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0ddf9796-92cf-4aae-b576-ca8d5e4d5d76 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1514 microversion: 2.1 time: 0.163450 Aug 05 14:30:24.321420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 252/502] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:24 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:25.226060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:25.226683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:25.233143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:25.233635 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:25.234078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:25.234879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:25.235376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:25.235813 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:25.341800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:25.342410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:25.349369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:25.349854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:25.350290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:25.350982 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:25.351439 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:25.351862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:25.365672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:25.373738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3834aebf-a644-4705-861f-7787e7a3aa21 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.151537 Aug 05 14:30:25.374309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 251/503] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:25 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:25.481101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:25.489191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7e43f63f-4ffe-4629-9387-7905ba9f0f8f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1514 microversion: 2.1 time: 0.151447 Aug 05 14:30:25.489753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 253/504] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:25 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:26.045450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-b6876672-5a81-47f4-aeed-bee6dba7af07 req-93dda531-0941-4058-8a92-adec991662c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d7eedb-e88e-448f-ab53-86cd9203b566", "name": "network-vif-deleted", "tag": "6237f1d2-d321-4dc4-88ac-012b853e5511"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:26.056109 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b6876672-5a81-47f4-aeed-bee6dba7af07 req-93dda531-0941-4058-8a92-adec991662c6 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:26.056626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b6876672-5a81-47f4-aeed-bee6dba7af07 req-93dda531-0941-4058-8a92-adec991662c6 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:26.057058 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b6876672-5a81-47f4-aeed-bee6dba7af07 req-93dda531-0941-4058-8a92-adec991662c6 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:26.067994 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-b6876672-5a81-47f4-aeed-bee6dba7af07 req-93dda531-0941-4058-8a92-adec991662c6 service nova] Creating event network-vif-deleted:6237f1d2-d321-4dc4-88ac-012b853e5511 for instance 79d7eedb-e88e-448f-ab53-86cd9203b566 on hv-cinder-80295 Aug 05 14:30:26.072916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-b6876672-5a81-47f4-aeed-bee6dba7af07 req-93dda531-0941-4058-8a92-adec991662c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031208 Aug 05 14:30:26.073493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 252/505] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:30:26.395622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:26.396211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:26.403038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:26.403525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:26.403961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:26.404665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:26.405116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:26.405547 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:26.510783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:26.511478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:26.523449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:26.523951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:26.524397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:26.525279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:26.525732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:26.526157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:26.539221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:26.547943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-54f5b2b4-0354-4d74-af82-57086a236079 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.156173 Aug 05 14:30:26.548579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 254/506] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:26 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:26.562325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:26.563385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:26.569256 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:26.569256 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lazy-loading 'fault' on Instance uuid 79d7eedb-e88e-448f-ab53-86cd9203b566 {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:30:26.604964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:26.612955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-12f973b7-60d0-4290-a8f2-3b85e48e7d8b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 200 len: 1309 microversion: 2.1 time: 0.107289 Aug 05 14:30:26.613513 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 253/507] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:26 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:26.800888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:30:26.801076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:30:27.569533 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:27.570130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:27.576477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:27.576986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:27.577413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:27.578753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:27.579266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:27.579702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:27.635480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:27.636089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: 79d7eedb-e88e-448f-ab53-86cd9203b566] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:27.643786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:27.644271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:27.644737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:27.645427 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:27.645878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:27.646301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:27.659536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] HTTP exception thrown: Instance 79d7eedb-e88e-448f-ab53-86cd9203b566 could not be found. Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Request method failure captured: Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 HTTP/1.1 Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SkkNuG3yQYVLwkvhEKRdsKSv_ZQH6RrPthbhD6ipUkIjnl-GLwnD5jIiTIf1lpW0_x02m2eBORVrhooWqjXRMQQxV-2bpLGh2cX7cpnQ2uNKmjni5nU6XYOsbsIhnTxWpR-nYTgCSuTpB8Mu7gRrbjnC3gLHWY7hroLwk3eUgW-syE Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 5e50310a4bcd4dd5acde809956702d0b Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1813108526 Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:30:27.661180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e50310a4bcd4dd5acde809956702d0b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e50310a4bcd4dd5acde809956702d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e50310a4bcd4dd5acde809956702d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e50310a4bcd4dd5acde809956702d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesSnapshotTestJSON-1813108526 Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 5e50310a4bcd4dd5acde809956702d0b Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1813108526 Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesSnapshotTestJSON-1813108526-project Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: cee6d9ed0c344584b8bf2fbe3c4178bf Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesSnapshotTestJSON-1813108526-project Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 79d7eedb-e88e-448f-ab53-86cd9203b566 could not be found. Aug 05 14:30:27.662493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '79d7eedb-e88e-448f-ab53-86cd9203b566'} Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d7eedb-e88e-448f-ab53-86cd9203b566 could not be found. Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:30:27.663321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d7eedb-e88e-448f-ab53-86cd9203b566 could not be found. Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d7eedb-e88e-448f-ab53-86cd9203b566 could not be found. Aug 05 14:30:27.664591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:30:27.665654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Returning 404 to user: Instance 79d7eedb-e88e-448f-ab53-86cd9203b566 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:30:27.665654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9230efa3-39a5-4f36-be82-e17c6cf0a593 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566" status: 404 len: 111 microversion: 2.1 time: 0.032255 Aug 05 14:30:27.665654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 254/508] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:27 2022] GET /compute/v2.1/servers/79d7eedb-e88e-448f-ab53-86cd9203b566 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:30:27.713930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:27.723030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-36932ee6-33ef-4dd4-b6cb-b1703bc66cc1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.157244 Aug 05 14:30:27.723597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 255/509] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:27 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:28.745590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:28.746854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:28.753907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:28.754392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:28.754830 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:28.755521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:28.755974 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:28.756397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:28.884576 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:28.892709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b2c8beb8-5b40-4c29-b687-d84ca3320580 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.150936 Aug 05 14:30:28.893271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 255/510] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:28 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:29.914382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:29.915002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:29.921466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:29.921937 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:29.922694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:29.923604 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:29.924054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:29.924502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:30.052600 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:30.060371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1f335ce3-349e-4b45-96aa-2ecbf5644757 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.149898 Aug 05 14:30:30.060953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 256/511] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:29 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:31.082945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:31.083548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:31.090295 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:31.090779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:31.091214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:31.091928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:31.092383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:31.092829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:31.226606 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:31.234407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-373265c4-db2c-43fc-84cf-bdabf3a4764b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.156101 Aug 05 14:30:31.235667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 256/512] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:31 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:32.256173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:32.256866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:32.263313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:32.263794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:32.264220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:32.264929 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:32.265368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:32.265778 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:32.404570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:32.407369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6d2109ba-a9ea-43b4-814f-cdd69afe2cb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.154227 Aug 05 14:30:32.407956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 257/513] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:32 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:33.428562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:33.429229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:33.435444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:33.436681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:33.436681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:33.437307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:33.437772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:33.438227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:33.576520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:33.587234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6ca6818f-252b-4dcf-b18f-8022d542fbb7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.162458 Aug 05 14:30:33.587800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 257/514] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:33 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:34.609448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:34.610560 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:34.617551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:34.618028 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:34.618468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:34.619149 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:34.619594 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:34.620013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:34.758514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:34.767844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1a743bbd-480b-4a75-a457-6dbeb7718fa4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.161797 Aug 05 14:30:34.768667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 258/515] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:34 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:35.788988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:35.789551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:35.795941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:35.796404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:35.796869 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:35.797789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:35.798589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:35.799357 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:35.927730 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:35.934044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c7c3181f-f3b6-45bb-83f1-24898d04cf0a tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.149040 Aug 05 14:30:35.934611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 258/516] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:35 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:36.955205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:36.955820 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:36.962414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:36.962897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:36.963333 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:36.964023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:36.964504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:36.965306 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:37.099083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:37.106990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5a525575-86e3-4f0e-ae7f-66a4550859d6 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.155737 Aug 05 14:30:37.107603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 259/517] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:36 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:38.129078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:38.129689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:38.136057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:38.136575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:38.137014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:38.137702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:38.138154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:38.138578 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:38.270558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:38.278607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ec9b395e-97a1-413d-9517-e30b4e87cbf0 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.153818 Aug 05 14:30:38.279179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 259/518] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:38 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:39.301661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:39.302211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:39.304552 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:39.309428 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:39.309909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:39.310345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:39.311036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:39.311561 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:39.312034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:39.449197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:39.458354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a939d0ff-c7cc-4e14-90af-d05af52f3b31 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.161357 Aug 05 14:30:39.459838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 260/519] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:39 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:40.228470 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1664006768", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "networks": [{"uuid": "2b311a85-6a72-40b8-b38e-650c49fd2616"}]}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:40.295795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] validate_networks() for [('2b311a85-6a72-40b8-b38e-650c49fd2616', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:30:40.481017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:40.484212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:40.491850 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:40.494095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:40.494560 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:40.495295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:40.495757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:40.496297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:40.833220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:40.842492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d83ca0d4-06df-4d89-a053-8ea5ac1090a1 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1732 microversion: 2.1 time: 0.365623 Aug 05 14:30:40.843080 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 261/520] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:40 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1732 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:40.970553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:30:40.971063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:30:40.971537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:30:40.971946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:30:40.972362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:30:40.981732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:40.982222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:40.982664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:40.983569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:40.984029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:40.984485 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:40.996944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=40 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:41.003193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Getting quotas for project 5e50310a4bcd4dd5acde809956702d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:30:41.007687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Getting quotas for user cee6d9ed0c344584b8bf2fbe3c4178bf and project 5e50310a4bcd4dd5acde809956702d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:30:41.019973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:30:41.022404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:30:41.193632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-aae449c3-6fe8-42ab-b0e9-6ae0e819f698 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968956 Aug 05 14:30:41.194269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 260/521] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 14:30:41.205550 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1066bb91-6e63-4029-8558-45ff0e04fff5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:41.206154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1066bb91-6e63-4029-8558-45ff0e04fff5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:41.269932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1066bb91-6e63-4029-8558-45ff0e04fff5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:41.278081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1066bb91-6e63-4029-8558-45ff0e04fff5 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1219 microversion: 2.1 time: 0.076712 Aug 05 14:30:41.279117 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 262/522] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:41 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:41.865132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:41.866097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:41.873625 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:41.874124 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:41.874566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:41.875269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:41.875727 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:41.876800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.012664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:42.023179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d7384792-ccce-4098-a0f4-68037b354c2e tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1712 microversion: 2.1 time: 0.163218 Aug 05 14:30:42.023805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 261/523] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:41 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:42.091670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:42.092191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:42.100829 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.102916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.102916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.102916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.103195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.103482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.187139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] HTTP exception thrown: Cannot 'detach_volume' instance fc1b02bb-3a27-4800-8db5-13accab2125e while it is in vm_state rescued Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Request method failure captured: Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments/f5399bdd-1d8e-4213-b4a6-dfcea23b5bad HTTP/1.1 Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShLeOGY3xgmoxbysO01GVLxdm7-SDIsutDqL0n72iPn3pT8haewb_NYOn5hSSjZT_Kt7bqRoRNgPeDTj8F0yshVjFRjQGjqPhSmi02yVuH86Bz5hiIYU6x0rFEYBr-JrCmCoIIVKx0jXYhc2ruelY7owXiKVaN8ma1VXdN7I8OpDzw Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:30:42.188844 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8725df4ddc2b4ec8accc5b0bd7b39a49", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: b9d62fe4e6de4308a3a51be3e900625f Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:30:42.190437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Cannot 'detach_volume' instance fc1b02bb-3a27-4800-8db5-13accab2125e while it is in vm_state rescued Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'server_id': 'fc1b02bb-3a27-4800-8db5-13accab2125e', 'id': 'f5399bdd-1d8e-4213-b4a6-dfcea23b5bad'} Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fc1b02bb-3a27-4800-8db5-13accab2125e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:30:42.191265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fc1b02bb-3a27-4800-8db5-13accab2125e while it is in vm_state rescued Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fc1b02bb-3a27-4800-8db5-13accab2125e while it is in vm_state rescued Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:30:42.192770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Returning 409 to user: Cannot 'detach_volume' instance fc1b02bb-3a27-4800-8db5-13accab2125e while it is in vm_state rescued {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:30:42.193923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6edbec84-4336-472a-aac2-8cb8d7f614b5 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments/f5399bdd-1d8e-4213-b4a6-dfcea23b5bad" status: 409 len: 152 microversion: 2.1 time: 0.103098 Aug 05 14:30:42.200125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:42.200625 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 263/524] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:30:42 2022] DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments/f5399bdd-1d8e-4213-b4a6-dfcea23b5bad => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 14:30:42.200771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:42.209088 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.211600 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.211600 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.211600 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.211600 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.212055 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.299962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:42.300605 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:42.307998 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.308505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.308963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.309696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.310143 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.311519 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.351762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:42.381428 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:42.389546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-311453e7-5af8-4715-9cb3-3e16a5cd18a7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1223 microversion: 2.1 time: 0.094192 Aug 05 14:30:42.390108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 264/525] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:42 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:30:42.476958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-420eac2a-3540-4505-a3cb-7e770f5bc76d tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "POST /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/action" status: 202 len: 0 microversion: 2.1 time: 0.280476 Aug 05 14:30:42.478078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 262/526] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:30:42 2022] POST /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:30:42.486657 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:42.487412 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:42.495227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.495727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.496185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.496986 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:42.497555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:42.497971 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:42.653000 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:42.661776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b90a9853-669e-4a07-827f-eece93db77cf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1720 microversion: 2.1 time: 0.179346 Aug 05 14:30:42.662357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 265/527] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:42 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:43.412161 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:43.412899 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:43.419820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:43.420318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:43.422738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:43.422738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:43.422738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:43.422738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:43.495462 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:43.505450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a0c75919-3afa-4512-9421-c38fc7c79207 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1271 microversion: 2.1 time: 0.098789 Aug 05 14:30:43.507699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 263/528] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:43 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:43.688371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:43.688371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:43.692658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:43.693252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:43.693792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:43.694583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:43.695104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:43.695759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:43.866856 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:43.877640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-550bdfc4-1336-4be7-9232-21ce0645577c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1720 microversion: 2.1 time: 0.197437 Aug 05 14:30:43.878387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 266/529] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:43 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:44.526815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:44.527385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:44.536406 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:44.536932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:44.537382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:44.538099 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:44.538637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:44.538984 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:44.685993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:44.695010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-19c3a00d-3c06-448c-9253-9bfc21b449cd tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.172186 Aug 05 14:30:44.695592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 264/530] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:44 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:44.904144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:44.904737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:44.911821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:44.912295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:44.912798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:44.913483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:44.913934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:44.914411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:45.050575 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:45.059385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-97e7bc59-df79-4f75-b896-33be8ba96a66 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1720 microversion: 2.1 time: 0.158704 Aug 05 14:30:45.059949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 267/531] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:44 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:45.717642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:45.718229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:45.725369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:45.725853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:45.726318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:45.727007 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:45.727456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:45.727876 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:45.866951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:45.874622 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2d31337a-50a4-4359-b19c-b0284cfa9b53 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.161257 Aug 05 14:30:45.875192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 265/532] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:45 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:46.082025 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:46.082542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:46.089089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:46.089599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:46.090309 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:46.091012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:46.091488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:46.091915 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:46.224843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:46.233062 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-51abf2d2-7e87-4649-a1fb-ca4d7b7fe325 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1720 microversion: 2.1 time: 0.155575 Aug 05 14:30:46.233848 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 268/533] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:46 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:46.895822 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:46.896469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:46.905018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:46.905753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:46.906419 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:46.907318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:46.909359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:46.909793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:47.062291 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:47.067246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-9d0642cf-f0e1-407a-9bf6-05b1b89ce30e req-57de8a06-dbfe-447f-b3b4-e834a3c2febc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e75d12-524e-42d2-819d-45555c33d0be", "tag": "869260f4-5173-4e8e-acbf-e81e8c4dffd0"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:47.071153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f06caa7c-00e2-4c46-ba6b-89f0ef8f0c5b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.179888 Aug 05 14:30:47.071719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 266/534] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:46 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:47.077837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-9d0642cf-f0e1-407a-9bf6-05b1b89ce30e req-57de8a06-dbfe-447f-b3b4-e834a3c2febc service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:47.078311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-9d0642cf-f0e1-407a-9bf6-05b1b89ce30e req-57de8a06-dbfe-447f-b3b4-e834a3c2febc service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:47.078730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-9d0642cf-f0e1-407a-9bf6-05b1b89ce30e req-57de8a06-dbfe-447f-b3b4-e834a3c2febc service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:47.093845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-9d0642cf-f0e1-407a-9bf6-05b1b89ce30e req-57de8a06-dbfe-447f-b3b4-e834a3c2febc service nova] Creating event network-changed:869260f4-5173-4e8e-acbf-e81e8c4dffd0 for instance c9e75d12-524e-42d2-819d-45555c33d0be on hv-cinder-80295 Aug 05 14:30:47.106032 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-9d0642cf-f0e1-407a-9bf6-05b1b89ce30e req-57de8a06-dbfe-447f-b3b4-e834a3c2febc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122374 Aug 05 14:30:47.107196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 269/535] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:30:47.254838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:47.255359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:47.261254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:47.261729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:47.262165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:47.262844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:47.263296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:47.263716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:47.399589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:47.407544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a7de232c-45ed-4d0d-9fc3-737ed7054ba4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1726 microversion: 2.1 time: 0.157315 Aug 05 14:30:47.408131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 267/536] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:47 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:47.429613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:47.430241 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:47.436593 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:47.437088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:47.437524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:47.438213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:47.438878 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:47.439881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:47.521554 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e08bdfa9-834f-4b6e-8607-8472af89d882 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096227 Aug 05 14:30:47.529672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 270/537] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:30:47 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:30:48.091350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:48.091969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:48.099179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:48.099676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:48.100150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:48.100897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:48.101356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:48.101789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:48.348853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:48.356547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d5f4c374-ea19-44e4-bb57-422537537ded tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.269330 Aug 05 14:30:48.357313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 268/538] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:48 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:48.613180 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-d23dfab2-76b7-4481-8629-35ac6807bc8b req-7d820905-2771-4632-a80b-4e32aba76317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1b02bb-3a27-4800-8db5-13accab2125e", "tag": "8450e1f6-6d1a-4979-ad7e-10276a4c2679"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:48.622255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d23dfab2-76b7-4481-8629-35ac6807bc8b req-7d820905-2771-4632-a80b-4e32aba76317 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:48.622724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d23dfab2-76b7-4481-8629-35ac6807bc8b req-7d820905-2771-4632-a80b-4e32aba76317 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:48.623147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d23dfab2-76b7-4481-8629-35ac6807bc8b req-7d820905-2771-4632-a80b-4e32aba76317 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:48.625753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:48.635279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-d23dfab2-76b7-4481-8629-35ac6807bc8b req-7d820905-2771-4632-a80b-4e32aba76317 service nova] Creating event network-changed:8450e1f6-6d1a-4979-ad7e-10276a4c2679 for instance fc1b02bb-3a27-4800-8db5-13accab2125e on hv-cinder-80295 Aug 05 14:30:48.640621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-d23dfab2-76b7-4481-8629-35ac6807bc8b req-7d820905-2771-4632-a80b-4e32aba76317 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088383 Aug 05 14:30:48.640870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 271/539] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:30:49.378094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:49.378711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:49.385180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:49.385660 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:49.386091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:49.388773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:49.389296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:49.389745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:49.519059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:49.527223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0db0bcfb-e634-4a9d-b798-5ec59ab7597a tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.153686 Aug 05 14:30:49.527796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 269/540] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:49 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:50.549596 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:50.550490 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:50.557059 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:50.557541 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:50.557973 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:50.558707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:50.559164 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:50.559586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:50.654633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-19020ee8-ac97-49a8-9865-c750e6398efd req-e861cd51-aab7-4880-b141-cd3384becd3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1b02bb-3a27-4800-8db5-13accab2125e", "tag": "8450e1f6-6d1a-4979-ad7e-10276a4c2679"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:50.665755 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-19020ee8-ac97-49a8-9865-c750e6398efd req-e861cd51-aab7-4880-b141-cd3384becd3c service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:50.666159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-19020ee8-ac97-49a8-9865-c750e6398efd req-e861cd51-aab7-4880-b141-cd3384becd3c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:50.666585 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-19020ee8-ac97-49a8-9865-c750e6398efd req-e861cd51-aab7-4880-b141-cd3384becd3c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:50.679518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-19020ee8-ac97-49a8-9865-c750e6398efd req-e861cd51-aab7-4880-b141-cd3384becd3c service nova] Creating event network-changed:8450e1f6-6d1a-4979-ad7e-10276a4c2679 for instance fc1b02bb-3a27-4800-8db5-13accab2125e on hv-cinder-80295 Aug 05 14:30:50.684787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-19020ee8-ac97-49a8-9865-c750e6398efd req-e861cd51-aab7-4880-b141-cd3384becd3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033840 Aug 05 14:30:50.685372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 270/541] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:30:50.699926 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:50.708015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c5cce6bb-97d7-4a37-b9eb-939bb4653b10 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.163820 Aug 05 14:30:50.708602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 272/542] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:50 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:51.729807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:51.730412 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:51.732359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:51.733085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:51.739369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:51.739853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:51.740324 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:51.741011 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:51.741461 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:51.741904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:51.879873 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:51.887444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e6b6ce86-039b-4491-a8b3-1c1c16f0e4d9 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.161854 Aug 05 14:30:51.888122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 271/543] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:51 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:52.909614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:52.910209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:52.912153 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:30:52.917495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:52.918609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:52.918609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:52.919114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:52.919568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:52.919991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:53.050836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:53.058285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6f15d20d-0431-4c96-953f-269590cca256 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.153514 Aug 05 14:30:53.058857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 273/544] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:52 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:54.081773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:54.082387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:54.088927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:54.089408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:54.089849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:54.090790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:54.091240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:54.091663 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:54.222355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:54.229796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3078fbbf-aa77-48e8-b914-c3ec653f0829 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.154475 Aug 05 14:30:54.230346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 272/545] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:54 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:55.250451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:55.251085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:55.257543 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:55.258033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:55.258476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:55.259172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:55.259629 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:55.260059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:55.295887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-d4143768-b803-4b5d-8822-9d6a27ff7095 req-ef138343-fb10-41a4-af75-5733768fae9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e75d12-524e-42d2-819d-45555c33d0be", "name": "network-vif-plugged", "status": "completed", "tag": "869260f4-5173-4e8e-acbf-e81e8c4dffd0"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:55.306076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d4143768-b803-4b5d-8822-9d6a27ff7095 req-ef138343-fb10-41a4-af75-5733768fae9f service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:55.306586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d4143768-b803-4b5d-8822-9d6a27ff7095 req-ef138343-fb10-41a4-af75-5733768fae9f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:55.306988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d4143768-b803-4b5d-8822-9d6a27ff7095 req-ef138343-fb10-41a4-af75-5733768fae9f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:55.319440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-d4143768-b803-4b5d-8822-9d6a27ff7095 req-ef138343-fb10-41a4-af75-5733768fae9f service nova] Creating event network-vif-plugged:869260f4-5173-4e8e-acbf-e81e8c4dffd0 for instance c9e75d12-524e-42d2-819d-45555c33d0be on hv-cinder-80295 Aug 05 14:30:55.324300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-d4143768-b803-4b5d-8822-9d6a27ff7095 req-ef138343-fb10-41a4-af75-5733768fae9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088478 Aug 05 14:30:55.325957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 274/546] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:30:55.397083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:55.404597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d7d8ec96-1cb0-43b6-8a2a-320e9ea24882 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.157831 Aug 05 14:30:55.405180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 273/547] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:55 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:56.427750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:56.428453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:56.434514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:56.434989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:56.435419 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:56.436094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:56.436651 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:56.437056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:56.570555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:56.577895 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-153db5e9-d44b-468d-a4ef-e84070bce239 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.155447 Aug 05 14:30:56.578454 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 275/548] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:56 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:57.598642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:57.599259 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:57.606052 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:57.606541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:57.607033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:57.607711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:57.608199 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:57.608687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:57.737484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:57.744795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b92be4eb-618c-4273-bba3-f68b71e33746 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1319 microversion: 2.1 time: 0.150208 Aug 05 14:30:57.745368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 274/549] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:57 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:58.765525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:30:58.766064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:58.772524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:58.773003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:58.773438 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:58.774116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:58.774566 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:58.774987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:58.902151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:30:58.910365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2f46ec21-0e6b-4199-83b0-02a90d810f37 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1507 microversion: 2.1 time: 0.148012 Aug 05 14:30:58.910958 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 276/550] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:30:58 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:30:58.930916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9e09821-355e-4cdd-a541-ae0a9027c57c", "device": "/dev/sdb"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:30:58.933813 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:30:58.940144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:58.940661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:58.941117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:58.941809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:30:58.942288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:30:58.942703 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:30:59.602626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e32016d5-58e1-44a1-ab10-c180cafec2f7 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "POST /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675375 Aug 05 14:30:59.603244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 275/551] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:30:58 2022] POST /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:31:03.838142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:03.838640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:03.844888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:03.845374 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:03.845808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:03.846499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:03.846952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:03.847376 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:03.930075 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lazy-loading 'services' on Instance uuid 0a17e392-41cb-4261-94a6-5f144eefe190 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:31:04.106290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ca4f552a-33ef-4ef6-822a-4cc4f47b4f4d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-volume_attachments/b56eed8c-3e66-42a1-bcc1-abc12a2176fb" status: 202 len: 0 microversion: 2.1 time: 0.368164 Aug 05 14:31:04.107037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 277/552] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:31:03 2022] DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-volume_attachments/b56eed8c-3e66-42a1-bcc1-abc12a2176fb => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:31:09.450664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:09.454867 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-96c61fb8-c297-424a-a55d-7d30e2ac0e63 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:31:09.460778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96c61fb8-c297-424a-a55d-7d30e2ac0e63 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:09.465976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96c61fb8-c297-424a-a55d-7d30e2ac0e63 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:09.465976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96c61fb8-c297-424a-a55d-7d30e2ac0e63 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:09.487002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-96c61fb8-c297-424a-a55d-7d30e2ac0e63 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Going to try to stop instance {{(pid=118053) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 14:31:09.698397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-96c61fb8-c297-424a-a55d-7d30e2ac0e63 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action" status: 202 len: 0 microversion: 2.1 time: 0.248944 Aug 05 14:31:09.698998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 276/553] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:31:09 2022] POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:31:09.708208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:09.709791 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:09.712256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=38 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:09.717463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:09.717971 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:09.718402 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:09.719082 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:09.719527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:09.719941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:09.856247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:09.863848 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-070a1ec9-86e6-4d66-bcc0-95335268c61a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.160178 Aug 05 14:31:09.864441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 278/554] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:09 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:10.886849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:10.887547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:10.893634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:10.894112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:10.894551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:10.895233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:10.895681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:10.896097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:11.023835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:11.027642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:11.031914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-09e3f2c8-3a16-48e8-bf5f-c8aefb998a71 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.150457 Aug 05 14:31:11.032499 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 277/555] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:10 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:12.051923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:12.052561 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:12.059118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:12.059592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:12.060025 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:12.060733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:12.061184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:12.061602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:12.192294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:12.200228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a50752dc-73ee-4e04-8778-8040a5d77ce5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.152120 Aug 05 14:31:12.200838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 279/556] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:12 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:13.222325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:13.222933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:13.229628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:13.232373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:13.232373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:13.232373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:13.232373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:13.232772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:13.359816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:13.367296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-774c2c90-cc8f-4064-b5ac-437f8d89dec7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.149635 Aug 05 14:31:13.368438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 278/557] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:13 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:14.389104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:14.389686 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:14.395799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:14.396458 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:14.396904 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:14.397598 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:14.398057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:14.398481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:14.531442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:14.539002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0da64f14-52ab-4209-9871-ff1be3b79dc2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.153971 Aug 05 14:31:14.539618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 280/558] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:14 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:15.560029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:15.560682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:15.567191 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:15.567677 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:15.568118 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:15.568833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:15.569291 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:15.569716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:15.697318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:15.704751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0e3e347e-dc12-4342-9c7f-8fcdd6f15df3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.148915 Aug 05 14:31:15.705318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 279/559] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:15 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:16.726805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:16.727994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:16.734382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:16.734861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:16.735321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:16.736002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:16.736479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:16.736898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:16.863730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:16.871657 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-94f0d2f2-1845-45a5-88f2-e40466347814 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.148840 Aug 05 14:31:16.872223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 281/560] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:16 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:17.893556 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:17.894177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:17.901090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:17.901573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:17.902012 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:17.902701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:17.903158 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:17.903584 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:18.032566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:18.040207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-78b4ed12-9fa4-4025-9eb5-2f69d8c37660 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.150472 Aug 05 14:31:18.040807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 280/561] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:17 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:19.061242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:19.061849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:19.068122 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:19.068635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:19.069071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:19.069743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:19.070185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:19.070599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:19.201749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:19.209087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c7661fc1-1b87-4a3c-aa76-d95234c4993d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.151898 Aug 05 14:31:19.209645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 282/562] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:19 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:20.230659 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:20.231290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:20.238112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:20.238710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:20.239223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:20.239991 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:20.240687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:20.241240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:20.374461 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:20.382414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ee721e06-64d6-438c-95a6-9a1708a8dfbc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.156260 Aug 05 14:31:20.383056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 281/563] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:20 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:21.403083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:21.403787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:21.410746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:21.411406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:21.411638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:21.412320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:21.412787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:21.413203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:21.415802 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:21.550026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:21.557698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-275abf3e-5953-4647-8460-f350fd24bead tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.158683 Aug 05 14:31:21.558259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 283/564] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:21 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:22.578240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:22.578889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:22.585232 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:22.585715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:22.586154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:22.587460 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:22.587917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:22.588343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:22.726057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:22.731763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-df35f749-1c69-4163-ad09-ed612abefd3d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.157285 Aug 05 14:31:22.732365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 282/565] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:22 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:23.733115 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:23.733590 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:23.739891 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:23.740367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:23.740824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:23.741500 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:23.741944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:23.742386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:23.752449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:23.753057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:23.760015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:23.760520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:23.760958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:23.761647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:23.762099 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:23.762518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:23.824826 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lazy-loading 'services' on Instance uuid c9e75d12-524e-42d2-819d-45555c33d0be {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:31:23.895186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:23.902680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a3bcdf22-76d1-4fb8-9a76-51e3bb6de6b7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.153936 Aug 05 14:31:23.903252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 283/566] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:23 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:31:24.083523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-27b99536-9e7d-44ef-a283-a0705014800b tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be/os-volume_attachments/a9e09821-355e-4cdd-a541-ae0a9027c57c" status: 202 len: 0 microversion: 2.1 time: 0.354128 Aug 05 14:31:24.084126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 284/567] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:31:23 2022] DELETE /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be/os-volume_attachments/a9e09821-355e-4cdd-a541-ae0a9027c57c => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:31:24.923066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:24.923681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:24.929930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:24.931258 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:24.931700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:24.932387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:24.932892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:24.936565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:25.100765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:25.108847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5cc1ff98-843d-4c50-b8ee-116ac00d8fa7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.189575 Aug 05 14:31:25.109411 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 284/568] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:24 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:26.130820 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:26.131508 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:26.138456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:26.138936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:26.139371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:26.140050 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:26.140544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:26.140968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:26.257866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:26.258711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:26.265071 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:26.265572 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:26.266014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:26.266716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:26.267178 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:26.267612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:26.274330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:26.281852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6e9acc56-51ec-4295-af47-aac8b76a8093 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.155805 Aug 05 14:31:26.282432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 285/569] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:26 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:26.293373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:31:26.575701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-895ebe72-fd78-4ccf-961e-7ed18ea7e8ac tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 204 len: 0 microversion: 2.1 time: 0.321470 Aug 05 14:31:26.576299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 285/570] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:31:26 2022] DELETE /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 14:31:26.590769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:26.591629 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:26.597665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:26.598146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:26.598582 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:26.599265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:26.599719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:26.600142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:26.726867 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:26.735007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6318d33e-9d80-4727-b5e5-dbabc398ae84 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1513 microversion: 2.1 time: 0.148653 Aug 05 14:31:26.735584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 286/571] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:26 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:27.303594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:27.304289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:27.311380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:27.311855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:27.312288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:27.312998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:27.313449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:27.313898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:27.443726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:27.451779 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-44a5abc0-4ea3-4431-8ee3-a577d350865a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.152393 Aug 05 14:31:27.452338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 286/572] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:27 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:27.754865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:27.755473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:27.762235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:27.762713 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:27.763146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:27.763824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:27.764272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:27.764733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:27.890499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:27.898014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ced75f8d-08b7-4284-9501-f06b429e3a54 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1513 microversion: 2.1 time: 0.147037 Aug 05 14:31:27.898582 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 287/573] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:27 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:28.472329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:28.472972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:28.480126 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:28.480645 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:28.481078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:28.481764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:28.482219 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:28.482640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:28.608669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:28.615992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cf934230-be1b-4cbc-9e46-ec982f75434e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1678 microversion: 2.1 time: 0.147587 Aug 05 14:31:28.616586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 287/574] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:28 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:28.925584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:28.928212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:28.934946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:28.935426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:28.935880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:28.936587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:28.937042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:28.937468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:29.075858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:29.083554 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2de925bd-2d74-402d-bc3b-00075a47d05f tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1513 microversion: 2.1 time: 0.167445 Aug 05 14:31:29.084210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 288/575] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:28 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:29.323358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-8f191c38-8dc0-48c2-95c1-53b88e84abeb req-a35b31f8-9991-46fb-b599-a71602edcd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e75d12-524e-42d2-819d-45555c33d0be", "name": "network-vif-deleted", "tag": "869260f4-5173-4e8e-acbf-e81e8c4dffd0"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:31:29.332649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-8f191c38-8dc0-48c2-95c1-53b88e84abeb req-a35b31f8-9991-46fb-b599-a71602edcd39 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:29.333130 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-8f191c38-8dc0-48c2-95c1-53b88e84abeb req-a35b31f8-9991-46fb-b599-a71602edcd39 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:29.333573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-8f191c38-8dc0-48c2-95c1-53b88e84abeb req-a35b31f8-9991-46fb-b599-a71602edcd39 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:29.346992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-8f191c38-8dc0-48c2-95c1-53b88e84abeb req-a35b31f8-9991-46fb-b599-a71602edcd39 service nova] Creating event network-vif-deleted:869260f4-5173-4e8e-acbf-e81e8c4dffd0 for instance c9e75d12-524e-42d2-819d-45555c33d0be on hv-cinder-80295 Aug 05 14:31:29.352587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-8f191c38-8dc0-48c2-95c1-53b88e84abeb req-a35b31f8-9991-46fb-b599-a71602edcd39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032765 Aug 05 14:31:29.353373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 288/576] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:31:29.636652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:29.637263 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:29.643236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:29.643745 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:29.644173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:29.644879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:29.645325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:29.646187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:29.777873 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:29.785378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bc3f2763-7e89-40f4-b56a-40af451e5da4 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1655 microversion: 2.1 time: 0.152687 Aug 05 14:31:29.785946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 289/577] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:29 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:29.807057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b8455725-a638-4081-ad39-2de88aa48af5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:31:29.813255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8455725-a638-4081-ad39-2de88aa48af5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:29.813734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8455725-a638-4081-ad39-2de88aa48af5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:29.814170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8455725-a638-4081-ad39-2de88aa48af5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:29.835618 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b8455725-a638-4081-ad39-2de88aa48af5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Going to try to start instance {{(pid=118053) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 14:31:29.990054 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b8455725-a638-4081-ad39-2de88aa48af5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action" status: 202 len: 0 microversion: 2.1 time: 0.187812 Aug 05 14:31:29.990677 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 289/578] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:31:29 2022] POST /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:31:29.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:30.000925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:30.007729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:30.008841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:30.009893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:30.010592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:30.011070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:30.011488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:30.106971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:30.107683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:30.114098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:30.114587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:30.115018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:30.115718 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:30.116168 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:30.116626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:30.148751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:30.149252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:30.149755 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:30.150195 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lazy-loading 'fault' on Instance uuid c9e75d12-524e-42d2-819d-45555c33d0be {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:31:30.152076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:30.159489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b30d522c-083c-458c-8f77-64a9b12f3015 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1664 microversion: 2.1 time: 0.164133 Aug 05 14:31:30.173205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 290/579] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:29 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:30.195140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee6d9ed0c344584b8bf2fbe3c4178bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50310a4bcd4dd5acde809956702d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:30.202970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-96126693-02a7-41fc-b756-7b4f0e01afd6 tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 200 len: 1309 microversion: 2.1 time: 0.101119 Aug 05 14:31:30.203545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 290/580] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:30 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:31:31.194707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:31.195317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:31.201666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:31.202146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:31.202578 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:31.203260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:31.203711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:31.204131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:31.223368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:31.223974 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] [instance: c9e75d12-524e-42d2-819d-45555c33d0be] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:31.231476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:31.231958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:31.232390 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:31.233106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:31.233559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:31.233996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:31.248325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] HTTP exception thrown: Instance c9e75d12-524e-42d2-819d-45555c33d0be could not be found. Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Request method failure captured: Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be HTTP/1.1 Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SkkNuG3yQYVLwkvhEKRdsKSv_ZQH6RrPthbhD6ipUkIjnl-GLwnD5jIiTIf1lpW0_x02m2eBORVrhooWqjXRMQQxV-2bpLGh2cX7cpnQ2uNKmjni5nU6XYOsbsIhnTxWpR-nYTgCSuTpB8Mu7gRrbjnC3gLHWY7hroLwk3eUgW-syE Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 5e50310a4bcd4dd5acde809956702d0b Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1813108526 Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:31:31.250110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e50310a4bcd4dd5acde809956702d0b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e50310a4bcd4dd5acde809956702d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e50310a4bcd4dd5acde809956702d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e50310a4bcd4dd5acde809956702d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesSnapshotTestJSON-1813108526 Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 5e50310a4bcd4dd5acde809956702d0b Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1813108526 Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesSnapshotTestJSON-1813108526-project Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: cee6d9ed0c344584b8bf2fbe3c4178bf Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesSnapshotTestJSON-1813108526-project Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance c9e75d12-524e-42d2-819d-45555c33d0be could not be found. Aug 05 14:31:31.251719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'c9e75d12-524e-42d2-819d-45555c33d0be'} Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e75d12-524e-42d2-819d-45555c33d0be could not be found. Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:31:31.252636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e75d12-524e-42d2-819d-45555c33d0be could not be found. Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e75d12-524e-42d2-819d-45555c33d0be could not be found. Aug 05 14:31:31.253959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:31.255905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] Returning 404 to user: Instance c9e75d12-524e-42d2-819d-45555c33d0be could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:31:31.255905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-150579dc-8ec2-4f06-bd1d-284af6cc4fce tempest-VolumesSnapshotTestJSON-1813108526 tempest-VolumesSnapshotTestJSON-1813108526-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be" status: 404 len: 111 microversion: 2.1 time: 0.032397 Aug 05 14:31:31.255905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 291/581] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:31 2022] GET /compute/v2.1/servers/c9e75d12-524e-42d2-819d-45555c33d0be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:31:31.334757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:31.343332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-70b6950c-efc2-4f1a-8cad-4f2f141cdfbf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1664 microversion: 2.1 time: 0.152484 Aug 05 14:31:31.343898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 291/582] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:31 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:32.364740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:32.365446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:32.372351 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:32.372874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:32.373315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:32.374005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:32.374464 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:32.374891 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:32.505776 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:32.509307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:32.513672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bd0ebafd-94aa-4983-acbd-733c651241ad tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1668 microversion: 2.1 time: 0.152859 Aug 05 14:31:32.520092 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 292/583] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:31:32 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:39.715555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:39.716056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:39.722202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:39.722682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:39.725363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:39.725363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:39.725363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:39.725363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:39.752858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-01e347cc-d7e8-4280-96e6-102876c9ace7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments/e94bb26d-438f-4666-8ff0-47ba63275f9e" status: 200 len: 194 microversion: 2.20 time: 0.141538 Aug 05 14:31:39.753388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 292/584] 10.222.0.26 () {60 vars in 1454 bytes} [Fri Aug 5 14:31:39 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments/e94bb26d-438f-4666-8ff0-47ba63275f9e => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:31:39.824066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:39.824738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:39.827030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:39.831972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:39.832732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:39.833171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:39.833859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:39.834313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:39.834739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:39.961211 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lazy-loading 'services' on Instance uuid 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:31:40.209918 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-45a68cc7-67fe-4f0d-bbd0-737a5b39ca85 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments/e94bb26d-438f-4666-8ff0-47ba63275f9e" status: 202 len: 0 microversion: 2.20 time: 0.390399 Aug 05 14:31:40.210512 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 293/585] 10.222.0.26 () {60 vars in 1457 bytes} [Fri Aug 5 14:31:39 2022] DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments/e94bb26d-438f-4666-8ff0-47ba63275f9e => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:31:40.219630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:40.221900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:40.224033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=30 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:40.228696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:40.236013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:40.236013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:40.236013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:40.236013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:40.236447 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:40.260971 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a6c3bce7-b2e2-4595-8180-5ab166b03ec3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045064 Aug 05 14:31:40.261534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 293/586] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Aug 5 14:31:40 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:31:41.274628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:41.276970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:41.283304 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:41.283790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:41.284223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:41.284937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:41.285426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:41.286073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:41.316133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-94e2f824-d4aa-48f6-9a43-ed06879bca98 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046348 Aug 05 14:31:41.316740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 294/587] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Aug 5 14:31:41 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:31:42.329524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:42.331606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:42.338312 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:42.338782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:42.339208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:42.339878 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:42.340322 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:42.340768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:42.368546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e3b1f0dd-0a60-434c-a34e-59380eaa9cb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043982 Aug 05 14:31:42.369116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 294/588] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Aug 5 14:31:42 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:31:42.430049 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:42.430583 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:42.437569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:42.438084 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:42.438470 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:42.439262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:42.439592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:42.440010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:42.465425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:31:42.799699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3f01463f-11eb-41ed-b6d8-16d7b507639c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 204 len: 0 microversion: 2.20 time: 0.373181 Aug 05 14:31:42.800305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 295/589] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Aug 5 14:31:42 2022] DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 14:31:42.818682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:42.819290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:42.825549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:42.826033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:42.826468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:42.827199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:42.827784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:42.830356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:42.972857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:42.980952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:42.982465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:42.984270 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e78742c2-4449-4f81-9e71-8086c0887535 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.168942 Aug 05 14:31:42.984997 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 295/590] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:42 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:44.009336 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:44.010041 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:44.017198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:44.017679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:44.018177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:44.018829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:44.019327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:44.019794 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:44.152879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:44.160970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:44.162493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:44.163641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a923298e-4644-47b4-bd0c-c86ac819d8e0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.158709 Aug 05 14:31:44.164210 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 296/591] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:44 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:45.187932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:45.188813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:45.195155 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:45.195628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:45.196058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:45.196782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:45.197228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:45.197647 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:45.331399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:45.340406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:45.342193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:45.343748 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8e0862d4-69eb-4603-a313-643e59ab8574 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1722 microversion: 2.20 time: 0.160467 Aug 05 14:31:45.344709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 296/592] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:45 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:46.082616 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-b29b9d64-605a-42c1-8edd-a0a4c033ffb0 req-58487f56-2cf4-4540-9ff8-007fbf8b0eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0b0a47-053b-4f94-ab1b-b801a7e86b6f", "name": "network-vif-deleted", "tag": "bafa58b3-94ca-4f7a-bd93-89c1cf350045"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:31:46.098750 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b29b9d64-605a-42c1-8edd-a0a4c033ffb0 req-58487f56-2cf4-4540-9ff8-007fbf8b0eb1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:46.099562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b29b9d64-605a-42c1-8edd-a0a4c033ffb0 req-58487f56-2cf4-4540-9ff8-007fbf8b0eb1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:46.100147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b29b9d64-605a-42c1-8edd-a0a4c033ffb0 req-58487f56-2cf4-4540-9ff8-007fbf8b0eb1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:46.117928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-b29b9d64-605a-42c1-8edd-a0a4c033ffb0 req-58487f56-2cf4-4540-9ff8-007fbf8b0eb1 service nova] Creating event network-vif-deleted:bafa58b3-94ca-4f7a-bd93-89c1cf350045 for instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f on hv-cinder-80295 Aug 05 14:31:46.125859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-b29b9d64-605a-42c1-8edd-a0a4c033ffb0 req-58487f56-2cf4-4540-9ff8-007fbf8b0eb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048986 Aug 05 14:31:46.127129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 297/593] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:31:46.368350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:46.369846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:46.377295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:46.377783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:46.378212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:46.378976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:46.379539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:46.380049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:46.459639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:46.469129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:46.471175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:46.472537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-65657964-8ca5-43d2-b2b0-e00f735b5e91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1655 microversion: 2.20 time: 0.108657 Aug 05 14:31:46.473257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 297/594] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:46 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:47.497314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:47.498007 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:47.505125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:47.505614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:47.506048 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:47.506735 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:47.507184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:47.507602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:47.573868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:47.581917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:47.583413 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:47.584574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6f668c99-245e-474c-89df-c80c2b68dbf3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1655 microversion: 2.20 time: 0.092137 Aug 05 14:31:47.585129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 298/595] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:47 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:48.607875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:48.609017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:48.615373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:48.615888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:48.616320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:48.617040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:48.617496 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:48.617914 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:48.680324 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:48.688932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:48.690362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:48.691502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b68db779-870a-47f2-91f9-fd2e672f0fb8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1655 microversion: 2.20 time: 0.087452 Aug 05 14:31:48.692059 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 298/596] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:48 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:31:49.714032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:49.714664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:49.722028 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:49.722504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:49.722923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:49.723596 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:49.724040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:49.724475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:49.784994 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:49.792799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:49.794291 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:49.795417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0134829f-f6bf-4612-b2c0-df1bb5f0091a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1655 microversion: 2.20 time: 0.085233 Aug 05 14:31:49.795964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 299/597] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:49 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:50.818634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:50.819248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:50.825869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:50.830679 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:50.830679 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:50.830679 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:50.830679 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:50.831086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:50.831522 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:31:50.861362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:50.861841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:50.862277 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:50.862719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lazy-loading 'fault' on Instance uuid 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:31:50.903929 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:50.912532 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:50.914031 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:50.915183 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7cae2209-7a12-43b4-9a01-86049b803853 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 200 len: 1372 microversion: 2.20 time: 0.100570 Aug 05 14:31:50.915746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 299/598] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:50 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:51.937844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:51.938490 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:51.945305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:51.945816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:51.946251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:51.946941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:51.947391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:51.947818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:51.961551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] HTTP exception thrown: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Request method failure captured: Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f HTTP/1.1 Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShXpBYryf6pTMHfsvnaYllcDyTP2OoQqG2GQJhK9scDJA4A8V83mPPyixp8POAsPHGbprZ6CvFs1gj5S4owV0Hc_-yxS8lg3i4l2YzLqGO9hVmCV91iwi-e3ZTT_Wn_gcukKgUS-0WSBKKt5B1hrggSU7IyGkh-Xf_awecb_xYeCHU Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:31:51.963184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13896c64e44b60838d3f313407433f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13896c64e44b60838d3f313407433f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 084b18670c2a4c1396d5912d130b2bac Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:31:51.964950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '6d0b0a47-053b-4f94-ab1b-b801a7e86b6f'} Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:31:51.965782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:31:51.967281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:31:51.970624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Returning 404 to user: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:31:51.970624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a07b67c8-47e1-4ae5-ae6b-0facf9ca17b1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 404 len: 111 microversion: 2.20 time: 0.031651 Aug 05 14:31:51.970624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 300/599] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:51 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:31:51.975409 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3e6639ba-bfaa-46c7-9d65-cef86f3d892d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '.version_select at 0x7fa75e25a0d0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:52.057360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3e6639ba-bfaa-46c7-9d65-cef86f3d892d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630565701" status: 204 len: 0 microversion: 2.20 time: 0.086017 Aug 05 14:31:52.057952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 300/600] 10.222.0.26 () {60 vars in 1262 bytes} [Fri Aug 5 14:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630565701 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 14:31:52.853889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9b9dda47-799c-4c93-a03e-737cb66492cf tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'create', calling method: .version_select at 0x7fa75d29fee0>, body: {"keypair": {"name": "tempest-keypair-1406816309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFvsAtZUjneG7U4L4t00Mu3KfEQfpSv9KD+luyAhKMRU+eywpF7ZZvrTyLXON1Sn1EVRdYXMhXcO+kKUmwZq1VdrHpM/ANQI0BOZJY7TNtrUcjsPPs4E4UVr24RTwO4A=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:31:52.869121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-9b9dda47-799c-4c93-a03e-737cb66492cf tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for project 5c13896c64e44b60838d3f313407433f. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:31:52.872937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-9b9dda47-799c-4c93-a03e-737cb66492cf tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for user 084b18670c2a4c1396d5912d130b2bac and project 5c13896c64e44b60838d3f313407433f. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:31:52.970229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9b9dda47-799c-4c93-a03e-737cb66492cf tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.120135 Aug 05 14:31:52.970851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 301/601] 10.222.0.26 () {62 vars in 1200 bytes} [Fri Aug 5 14:31:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 14:31:55.296894 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-672284917", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f6048a0-a883-4ba7-8de3-615ae195e1ec"}], "security_groups": [{"name": "tempest-securitygroup--1050684487"}], "key_name": "tempest-keypair-1406816309", "user_data": "}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:31:55.402112 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] validate_networks() for [('6f6048a0-a883-4ba7-8de3-615ae195e1ec', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:31:55.810198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:31:55.810617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:31:55.811109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:31:55.811524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:31:55.811945 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:31:55.821260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:55.821746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:55.822182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:55.822937 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:31:55.823393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:31:55.823826 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:31:55.840489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for project 5c13896c64e44b60838d3f313407433f. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:31:55.845337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Getting quotas for user 084b18670c2a4c1396d5912d130b2bac and project 5c13896c64e44b60838d3f313407433f. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:31:55.856963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:31:55.859239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:31:55.991122 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7e83bf87-a7e4-45e6-a70c-c51b6a56f4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.699161 Aug 05 14:31:55.991808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 301/602] 10.222.0.26 () {62 vars in 1188 bytes} [Fri Aug 5 14:31:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 14:31:56.003614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fdf94cf6-9930-4ce0-aa5d-37db04c5d580 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:56.004299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fdf94cf6-9930-4ce0-aa5d-37db04c5d580 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:56.057962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fdf94cf6-9930-4ce0-aa5d-37db04c5d580 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:56.065203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fdf94cf6-9930-4ce0-aa5d-37db04c5d580 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:56.066711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fdf94cf6-9930-4ce0-aa5d-37db04c5d580 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:56.067808 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fdf94cf6-9930-4ce0-aa5d-37db04c5d580 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1281 microversion: 2.20 time: 0.069232 Aug 05 14:31:56.068365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 302/603] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:55 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:57.090789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7f9f43e5-970e-4511-aaec-43719b69f38e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:57.091408 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7f9f43e5-970e-4511-aaec-43719b69f38e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:57.146002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7f9f43e5-970e-4511-aaec-43719b69f38e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:57.153577 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7f9f43e5-970e-4511-aaec-43719b69f38e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:57.155058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7f9f43e5-970e-4511-aaec-43719b69f38e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:57.156242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7f9f43e5-970e-4511-aaec-43719b69f38e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1281 microversion: 2.20 time: 0.069731 Aug 05 14:31:57.157974 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 302/604] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:57 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:58.180101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-64068763-c6be-4df1-878e-3fbc025d4fc6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:58.180751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-64068763-c6be-4df1-878e-3fbc025d4fc6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:58.235495 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-64068763-c6be-4df1-878e-3fbc025d4fc6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:58.242591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-64068763-c6be-4df1-878e-3fbc025d4fc6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:58.245778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-64068763-c6be-4df1-878e-3fbc025d4fc6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:58.245778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-64068763-c6be-4df1-878e-3fbc025d4fc6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1281 microversion: 2.20 time: 0.068904 Aug 05 14:31:58.245778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 303/605] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:58 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:31:59.267720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e2b63ebf-1463-4423-9bec-b95246d02454 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:31:59.268331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e2b63ebf-1463-4423-9bec-b95246d02454 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:31:59.323634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e2b63ebf-1463-4423-9bec-b95246d02454 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:59.330942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e2b63ebf-1463-4423-9bec-b95246d02454 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:59.332495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e2b63ebf-1463-4423-9bec-b95246d02454 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:31:59.333631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e2b63ebf-1463-4423-9bec-b95246d02454 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1281 microversion: 2.20 time: 0.069915 Aug 05 14:31:59.334189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 303/606] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:31:59 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:00.355133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:00.355827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:00.362699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:00.363179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:00.363608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:00.364285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:00.364775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:00.365198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:00.424647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:00.432431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:00.433947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:00.435067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8ce0ece5-3adc-487a-a83c-2bdd323861a6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1285 microversion: 2.20 time: 0.083873 Aug 05 14:32:00.435619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 304/607] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:00 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:01.458209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:01.459329 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:01.466010 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:01.466509 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:01.467207 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:01.467896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:01.468349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:01.468798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:01.530086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:01.538795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:01.540301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:01.541422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9306613d-1376-4b14-821d-a372a8de7cfc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1277 microversion: 2.20 time: 0.087682 Aug 05 14:32:01.541987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 304/608] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:01 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:02.565772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:02.566732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:02.572898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:02.573372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:02.574100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:02.574788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:02.575272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:02.575689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:02.640172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:02.649369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:02.650939 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:02.652085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-481ad4c2-be40-4d17-a71d-bab41f18cf2c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1339 microversion: 2.20 time: 0.091008 Aug 05 14:32:02.652682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 305/609] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:02 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:03.675631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:03.676237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:03.683530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:03.684016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:03.684465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:03.685154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:03.685776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:03.686399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:03.874957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:03.883577 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:03.885101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:03.886228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f8489239-4c2e-434a-8118-d9e764004dea tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.214886 Aug 05 14:32:03.886784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 305/610] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:03 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:04.233408 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-f8f7e23c-e828-4208-be73-d442504c9138 req-682b1e7a-0c2b-4f8c-abc3-58f45ef4ad51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:04.244228 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f8f7e23c-e828-4208-be73-d442504c9138 req-682b1e7a-0c2b-4f8c-abc3-58f45ef4ad51 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:04.244816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f8f7e23c-e828-4208-be73-d442504c9138 req-682b1e7a-0c2b-4f8c-abc3-58f45ef4ad51 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:04.245317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f8f7e23c-e828-4208-be73-d442504c9138 req-682b1e7a-0c2b-4f8c-abc3-58f45ef4ad51 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:04.256500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-f8f7e23c-e828-4208-be73-d442504c9138 req-682b1e7a-0c2b-4f8c-abc3-58f45ef4ad51 service nova] Creating event network-changed:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:32:04.261366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-f8f7e23c-e828-4208-be73-d442504c9138 req-682b1e7a-0c2b-4f8c-abc3-58f45ef4ad51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031689 Aug 05 14:32:04.261962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 306/611] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:04.908958 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:04.909784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:04.916297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:04.916812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:04.917245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:04.917938 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:04.918390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:04.918810 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:05.057162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:05.065193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:05.066725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:05.067837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6337bc0d-9d57-43fe-9dc1-1dce9f0b919d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.163527 Aug 05 14:32:05.068426 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 306/612] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:04 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:06.091110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:06.092049 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:06.099006 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:06.099493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:06.099933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:06.100661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:06.101120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:06.101549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:06.229018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:06.236829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:06.238348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:06.239442 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-caea6328-a811-430c-9ff3-58c67c97b14f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.153213 Aug 05 14:32:06.240011 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 307/613] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:06 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:07.262417 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:07.262958 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:07.264870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:07.270817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:07.277483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:07.277483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:07.277483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:07.277483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:07.277862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:07.405556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:07.414393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:07.415926 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:07.417026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8f98670b-531f-4142-98c9-34f4357507e4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.158558 Aug 05 14:32:07.417580 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 307/614] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:07 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:07.431048 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:07.431616 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:07.438089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:07.438571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:07.439013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:07.439700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:07.440159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:07.440627 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:07.522874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lazy-loading 'services' on Instance uuid fc1b02bb-3a27-4800-8db5-13accab2125e {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:32:07.746542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-01773bc7-4a68-4241-8f19-cb07cea9bddf tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments/f5399bdd-1d8e-4213-b4a6-dfcea23b5bad" status: 202 len: 0 microversion: 2.1 time: 0.319274 Aug 05 14:32:07.747138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 308/615] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:32:07 2022] DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments/f5399bdd-1d8e-4213-b4a6-dfcea23b5bad => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:32:07.756138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:07.758455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:07.764455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:07.764938 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:07.765388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:07.766064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:07.766518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:07.766943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:07.795764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6bf19377-6c21-4c4b-bd36-94d974e30a28 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Aug 05 14:32:07.796329 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 308/616] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:32:07 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:08.436472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=8 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:08.442065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:08.447556 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:08.449254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:08.449564 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:08.450084 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:08.450774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:08.451236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:08.451809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:08.585717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:08.594880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:08.596465 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:08.598283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9a63459a-7c9e-4a07-a3b2-d541d554a0dd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.162747 Aug 05 14:32:08.598850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 309/617] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:08 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:08.808342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:08.810517 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:08.817257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:08.817734 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:08.818197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:08.818884 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:08.819332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:08.819799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:08.851980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-640a8d91-1a6a-46a7-a4af-8f5bc6f3ff57 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 Aug 05 14:32:08.852582 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 309/618] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:32:08 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:09.621586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:09.622193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:09.629476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:09.630118 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:09.630566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:09.631266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:09.631720 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:09.632143 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:09.766034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:09.773997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:09.775503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:09.776626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e3b25550-bd90-4113-a821-b717a538dfdc tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.158972 Aug 05 14:32:09.777187 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 310/619] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:09 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:09.864941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:09.867061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:09.868994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=10 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:09.876026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:09.876026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:09.876026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:09.876026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:09.876476 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:09.876699 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:09.905193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-da4aa3dd-c2e1-4081-8c5c-f7736229a2c7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044919 Aug 05 14:32:09.905753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 310/620] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:32:09 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:32:09.995248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:09.995747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:09.997666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:10.002433 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.002916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.003421 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.004168 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.004727 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.005162 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.007707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:10.030403 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:32:10.313489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-914007cf-f770-46c8-ab1f-bff154c436d4 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 204 len: 0 microversion: 2.1 time: 0.321776 Aug 05 14:32:10.314115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 311/621] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:32:09 2022] DELETE /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:32:10.323016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:10.323616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:10.329653 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.333376 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.333376 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.333376 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.333376 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.333772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.460279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:10.468070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-da389366-d2ed-4193-843a-64caadbed898 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1686 microversion: 2.1 time: 0.149258 Aug 05 14:32:10.468677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 311/622] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:10 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:10.800077 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:10.801607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:10.808318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.808834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.809266 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.809983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.810436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.810862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.822352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-ff30849b-a312-4786-9552-c547430fbdf8 req-cc570239-06b9-4cc6-95b4-bcb9a786d164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "name": "network-vif-plugged", "status": "completed", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:10.832372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-ff30849b-a312-4786-9552-c547430fbdf8 req-cc570239-06b9-4cc6-95b4-bcb9a786d164 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:10.832886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-ff30849b-a312-4786-9552-c547430fbdf8 req-cc570239-06b9-4cc6-95b4-bcb9a786d164 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:10.833317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-ff30849b-a312-4786-9552-c547430fbdf8 req-cc570239-06b9-4cc6-95b4-bcb9a786d164 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:10.844715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-ff30849b-a312-4786-9552-c547430fbdf8 req-cc570239-06b9-4cc6-95b4-bcb9a786d164 service nova] Creating event network-vif-plugged:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:32:10.850420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-ff30849b-a312-4786-9552-c547430fbdf8 req-cc570239-06b9-4cc6-95b4-bcb9a786d164 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Aug 05 14:32:10.851022 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 312/623] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:32:10.944561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:10.952636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:10.954123 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:10.955213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d8e41982-8005-4494-b2cb-4c61cf28c012 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.160532 Aug 05 14:32:10.955773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 312/624] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:10 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:11.490039 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:11.490733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:11.496913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:11.497392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:11.497824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:11.498504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:11.498954 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:11.499372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:11.630744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:11.638120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d643c308-b9d2-45e5-8279-5f9e6717e8f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1686 microversion: 2.1 time: 0.153073 Aug 05 14:32:11.638684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 313/625] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:11 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:11.977911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:11.978603 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:11.985097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:11.989121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:11.989121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:11.989121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:11.989121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:11.989500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:12.117007 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:12.124947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:12.126450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:12.127586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e4e0314f-6fc1-4b8f-9828-45d0419dd282 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.153603 Aug 05 14:32:12.128145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 313/626] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:11 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:12.659016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:12.660216 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:12.662592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:12.667207 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:12.672119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:12.672119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:12.672119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:12.672119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:12.672527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:12.801824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:12.809371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-fb77c617-4d75-467e-939d-407a74bf1696 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1686 microversion: 2.1 time: 0.154184 Aug 05 14:32:12.809935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 314/627] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:12 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:13.150611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:13.151220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:13.157757 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:13.158238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:13.158672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:13.159356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:13.159845 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:13.160404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:13.286175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:13.293938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:13.295430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:13.296541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-33373c05-ca16-4d24-a096-2214e3074c77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.149804 Aug 05 14:32:13.297083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 314/628] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:13 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:13.829798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:13.830334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:13.837017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:13.837495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:13.837928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:13.838611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:13.839063 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:13.839483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:13.970422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:13.978722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9327e857-87ec-4e92-9607-0af1d40a4a1c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1686 microversion: 2.1 time: 0.152795 Aug 05 14:32:13.979295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 315/629] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:13 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:14.319221 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:14.319909 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:14.326330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:14.326810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:14.327241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:14.327926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:14.328428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:14.328862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:14.464905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:14.473004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:14.474553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:14.475646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d92aa97d-2662-4dd3-901d-df9a133c74d7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.160354 Aug 05 14:32:14.476205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 315/630] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:14 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:15.000334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:15.000972 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:15.008052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:15.008584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:15.009031 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:15.009724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:15.010172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:15.010593 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:15.140266 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:15.148033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c20bad0a-36d7-4a9a-8c44-508f3fdb8ccd tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1686 microversion: 2.1 time: 0.151851 Aug 05 14:32:15.148646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 316/631] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:14 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:15.498102 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:15.498680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:15.505064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:15.505552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:15.505988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:15.506683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:15.507137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:15.507561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:15.643251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:15.652444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:15.654090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:15.655454 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-69ba2d56-94a0-4e82-a0b0-f661f4dca538 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1407 microversion: 2.20 time: 0.161461 Aug 05 14:32:15.668952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 316/632] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:15 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:15.913670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-964c4407-bcbb-4910-9b31-86c7f4f13389 req-637c0099-84b7-434f-88f6-afd5483c5f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1b02bb-3a27-4800-8db5-13accab2125e", "name": "network-vif-deleted", "tag": "8450e1f6-6d1a-4979-ad7e-10276a4c2679"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:15.925572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-964c4407-bcbb-4910-9b31-86c7f4f13389 req-637c0099-84b7-434f-88f6-afd5483c5f4c service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:15.926345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-964c4407-bcbb-4910-9b31-86c7f4f13389 req-637c0099-84b7-434f-88f6-afd5483c5f4c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:15.927251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-964c4407-bcbb-4910-9b31-86c7f4f13389 req-637c0099-84b7-434f-88f6-afd5483c5f4c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:15.940636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-964c4407-bcbb-4910-9b31-86c7f4f13389 req-637c0099-84b7-434f-88f6-afd5483c5f4c service nova] Creating event network-vif-deleted:8450e1f6-6d1a-4979-ad7e-10276a4c2679 for instance fc1b02bb-3a27-4800-8db5-13accab2125e on hv-cinder-80295 Aug 05 14:32:15.946935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-964c4407-bcbb-4910-9b31-86c7f4f13389 req-637c0099-84b7-434f-88f6-afd5483c5f4c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038523 Aug 05 14:32:15.947695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 317/633] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:16.169979 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:16.170794 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:16.177371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:16.178527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:16.179051 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:16.179837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:16.180724 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:16.181201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:16.243646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:16.251509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-18408c20-206a-4a37-81f0-384c3279ba04 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 200 len: 1328 microversion: 2.1 time: 0.085594 Aug 05 14:32:16.252192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 317/634] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:16 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:16.681132 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:16.681854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:16.688045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:16.688594 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:16.689020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:16.689717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:16.690171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:16.690598 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:16.828660 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:16.837851 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:16.839377 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:16.840613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4bc5b609-243a-4dba-9008-6a40ae305afd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1599 microversion: 2.20 time: 0.165258 Aug 05 14:32:16.841493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 318/635] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:32:16 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:32:16.867164 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:16.867164 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:16.871289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:16.871780 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:16.872252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:16.872987 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:16.873442 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:16.873868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:16.960917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-29a3e1fd-af31-4a48-9cc1-c9d349377c1f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101291 Aug 05 14:32:16.961550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 318/636] 10.222.0.26 () {60 vars in 1316 bytes} [Fri Aug 5 14:32:16 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:32:17.274034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:17.274671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: fc1b02bb-3a27-4800-8db5-13accab2125e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:17.280613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:17.281101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:17.281538 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:17.282226 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:17.282684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:17.283113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:17.296514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] HTTP exception thrown: Instance fc1b02bb-3a27-4800-8db5-13accab2125e could not be found. Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Request method failure captured: Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e HTTP/1.1 Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShLeOGY3xgmoxbysO01GVLxdm7-SDIsutDqL0n72iPn3pT8haewb_NYOn5hSSjZT_Kt7bqRoRNgPeDTj8F0yshVjFRjQGjqPhSmi02yVuH86Bz5hiIYU6x0rFEYBr-JrCmCoIIVKx0jXYhc2ruelY7owXiKVaN8ma1VXdN7I8OpDzw Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:32:17.298152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8725df4ddc2b4ec8accc5b0bd7b39a49", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: b9d62fe4e6de4308a3a51be3e900625f Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance fc1b02bb-3a27-4800-8db5-13accab2125e could not be found. Aug 05 14:32:17.299759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'fc1b02bb-3a27-4800-8db5-13accab2125e'} Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1b02bb-3a27-4800-8db5-13accab2125e could not be found. Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:32:17.302406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1b02bb-3a27-4800-8db5-13accab2125e could not be found. Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1b02bb-3a27-4800-8db5-13accab2125e could not be found. Aug 05 14:32:17.303953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:17.305170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Returning 404 to user: Instance fc1b02bb-3a27-4800-8db5-13accab2125e could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:32:17.305170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cc75dce1-d346-46af-8239-e3381bff416c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e" status: 404 len: 111 microversion: 2.1 time: 0.029700 Aug 05 14:32:17.305170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 319/637] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:17 2022] GET /compute/v2.1/servers/fc1b02bb-3a27-4800-8db5-13accab2125e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:32:17.308678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d158a17b-9297-43cc-848d-99d03d9dfb02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '.version_select at 0x7fa75d3733a0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:17.378029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d158a17b-9297-43cc-848d-99d03d9dfb02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-35680142" status: 202 len: 0 microversion: 2.1 time: 0.073062 Aug 05 14:32:17.378620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 319/638] 10.222.0.26 () {58 vars in 1215 bytes} [Fri Aug 5 14:32:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-35680142 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:32:18.236099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-e4c0db89-d208-4b03-b7ec-6a5d58abf02a req-ebf96245-997f-4da7-9cdf-82d216d892bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:18.246441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e4c0db89-d208-4b03-b7ec-6a5d58abf02a req-ebf96245-997f-4da7-9cdf-82d216d892bc service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:18.246914 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e4c0db89-d208-4b03-b7ec-6a5d58abf02a req-ebf96245-997f-4da7-9cdf-82d216d892bc service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:18.247331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e4c0db89-d208-4b03-b7ec-6a5d58abf02a req-ebf96245-997f-4da7-9cdf-82d216d892bc service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:18.259552 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-e4c0db89-d208-4b03-b7ec-6a5d58abf02a req-ebf96245-997f-4da7-9cdf-82d216d892bc service nova] Creating event network-changed:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:32:18.264779 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-e4c0db89-d208-4b03-b7ec-6a5d58abf02a req-ebf96245-997f-4da7-9cdf-82d216d892bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Aug 05 14:32:18.265650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 320/639] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:21.069799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:21.070288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:21.076791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:21.077267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:21.077696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:21.078371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:21.078840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:21.079241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:21.104297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:32:21.391876 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cee4cf74-491b-4998-9753-a63794deeb3b tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 204 len: 0 microversion: 2.1 time: 0.326387 Aug 05 14:32:21.392488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 320/640] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:32:21 2022] DELETE /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:32:21.401247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:21.401940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:21.408732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:21.409205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:21.409637 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:21.410831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:21.411539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:21.411957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:21.545826 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:21.548159 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:21.554015 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-60cc1746-ad39-48a2-8d06-71b655683e02 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1508 microversion: 2.1 time: 0.157208 Aug 05 14:32:21.554576 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 321/641] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:21 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:22.575268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:22.575962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:22.582359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:22.583187 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:22.584696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:22.584696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:22.584949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:22.585379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:22.752091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:22.760904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a1e7a86e-7fbc-40ed-8520-339dc5ad6003 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1508 microversion: 2.1 time: 0.189769 Aug 05 14:32:22.762112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 321/642] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:22 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:22.786583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-cf594462-a338-4642-9439-37735cd05509 req-9dbbb741-8f28-4f16-80f9-d09e512ae0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ecbb29-5d49-412c-8436-189fb1a14079", "name": "network-vif-deleted", "tag": "3334ae2f-5b07-4c8f-9969-546288fe7c42"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:22.798980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-cf594462-a338-4642-9439-37735cd05509 req-9dbbb741-8f28-4f16-80f9-d09e512ae0fb service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:22.800001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-cf594462-a338-4642-9439-37735cd05509 req-9dbbb741-8f28-4f16-80f9-d09e512ae0fb service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:22.800671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-cf594462-a338-4642-9439-37735cd05509 req-9dbbb741-8f28-4f16-80f9-d09e512ae0fb service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:22.814020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-cf594462-a338-4642-9439-37735cd05509 req-9dbbb741-8f28-4f16-80f9-d09e512ae0fb service nova] Creating event network-vif-deleted:3334ae2f-5b07-4c8f-9969-546288fe7c42 for instance 93ecbb29-5d49-412c-8436-189fb1a14079 on hv-cinder-80295 Aug 05 14:32:22.819332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-cf594462-a338-4642-9439-37735cd05509 req-9dbbb741-8f28-4f16-80f9-d09e512ae0fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 Aug 05 14:32:22.820215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 322/643] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:23.320516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:23.320964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:23.326963 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.327443 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.327877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.328609 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.329073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.329495 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.353212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lazy-loading 'flavor' on Instance uuid de6a4095-fa11-4d30-ab95-ee35d9d69dbe {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:32:23.593407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fbc02d5b-9d4f-4ae9-84bf-ac5c4b12adc8 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "POST /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe/action" status: 202 len: 0 microversion: 2.1 time: 0.276756 Aug 05 14:32:23.594063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 322/644] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:32:23 2022] POST /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:32:23.603134 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:23.603865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:23.609975 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.610451 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.611196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.611828 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.612282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.612727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.747652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:23.756117 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e905dce1-fcc6-4a0d-932f-7a3050ce7563 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.157337 Aug 05 14:32:23.756730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 323/645] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:23 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:23.784049 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:23.784966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:23.791671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.792151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.792624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.793300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.793758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.794168 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.826758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:23.827269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:23.827731 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:23.828166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lazy-loading 'fault' on Instance uuid 93ecbb29-5d49-412c-8436-189fb1a14079 {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:32:23.830945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:23.874934 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:23.883104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-977a0360-be33-4a01-aa51-a406037a861c tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 200 len: 1312 microversion: 2.1 time: 0.103274 Aug 05 14:32:23.883675 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 323/646] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:23 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:24.778151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:24.778672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:24.785082 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:24.786189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:24.786640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:24.787322 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:24.787776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:24.788196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:24.904281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:24.904946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 93ecbb29-5d49-412c-8436-189fb1a14079] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:24.912147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:24.912661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:24.913106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:24.913803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:24.914260 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:24.914684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:24.920048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:24.927757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d46cb8df-aaaf-4f00-acc6-67f7b9ac42ca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.153530 Aug 05 14:32:24.928387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] HTTP exception thrown: Instance 93ecbb29-5d49-412c-8436-189fb1a14079 could not be found. Aug 05 14:32:24.928559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 324/647] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:24 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Request method failure captured: Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 HTTP/1.1 Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShLeOGY3xgmoxbysO01GVLxdm7-SDIsutDqL0n72iPn3pT8haewb_NYOn5hSSjZT_Kt7bqRoRNgPeDTj8F0yshVjFRjQGjqPhSmi02yVuH86Bz5hiIYU6x0rFEYBr-JrCmCoIIVKx0jXYhc2ruelY7owXiKVaN8ma1VXdN7I8OpDzw Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:32:24.930066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8725df4ddc2b4ec8accc5b0bd7b39a49", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: b9d62fe4e6de4308a3a51be3e900625f Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 93ecbb29-5d49-412c-8436-189fb1a14079 could not be found. Aug 05 14:32:24.931746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '93ecbb29-5d49-412c-8436-189fb1a14079'} Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ecbb29-5d49-412c-8436-189fb1a14079 could not be found. Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:32:24.933528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ecbb29-5d49-412c-8436-189fb1a14079 could not be found. Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ecbb29-5d49-412c-8436-189fb1a14079 could not be found. Aug 05 14:32:24.934952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:32:24.936193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Returning 404 to user: Instance 93ecbb29-5d49-412c-8436-189fb1a14079 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:32:24.936193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3f84312c-152b-41b6-8767-fab88f824132 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 05 14:32:24.936193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 324/648] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:24 2022] GET /compute/v2.1/servers/93ecbb29-5d49-412c-8436-189fb1a14079 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:32:24.939825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:24.940318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:24.946747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:24.947231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:24.947675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:24.948369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:24.948853 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:24.949279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:24.974010 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:32:25.285099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a5211650-c604-4175-a1eb-6c223c2fe6f7 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 204 len: 0 microversion: 2.1 time: 0.348723 Aug 05 14:32:25.285723 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 325/649] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:32:24 2022] DELETE /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 14:32:25.293561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:25.294176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:25.300586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:25.301672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:25.302268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:25.302961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:25.303417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:25.303847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:25.431442 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:25.438734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e0d72c6a-17b9-488b-a481-ee621b68a4f2 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.148975 Aug 05 14:32:25.439289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 325/650] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:25 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:25.949291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:25.949983 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:25.956399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:25.956960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:25.958158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:25.958992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:25.959440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:25.959859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:26.093888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:26.102248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0bbafec1-df72-4743-bec7-d7199786145f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.157307 Aug 05 14:32:26.102818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 326/651] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:25 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:26.461306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:26.461946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:26.468782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:26.469274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:26.469712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:26.470428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:26.470884 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:26.471309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:26.602182 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:26.609594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a3815551-dfe9-4be3-89c7-895af9c2f286 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1521 microversion: 2.1 time: 0.153080 Aug 05 14:32:26.610154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 326/652] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:26 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:26.741152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-d8d8309d-60c1-45e5-ae34-a7c96a0e036e req-d9fcacb3-431f-489e-a01c-443da8b97978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145b6612-d562-4fb1-8ef7-35259df1cf19", "name": "network-vif-deleted", "tag": "5d11bb3d-e647-4217-aeeb-63b14f3f279a"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:26.750289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d8d8309d-60c1-45e5-ae34-a7c96a0e036e req-d9fcacb3-431f-489e-a01c-443da8b97978 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:26.755410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d8d8309d-60c1-45e5-ae34-a7c96a0e036e req-d9fcacb3-431f-489e-a01c-443da8b97978 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:26.755410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d8d8309d-60c1-45e5-ae34-a7c96a0e036e req-d9fcacb3-431f-489e-a01c-443da8b97978 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:26.762415 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-d8d8309d-60c1-45e5-ae34-a7c96a0e036e req-d9fcacb3-431f-489e-a01c-443da8b97978 service nova] Creating event network-vif-deleted:5d11bb3d-e647-4217-aeeb-63b14f3f279a for instance 145b6612-d562-4fb1-8ef7-35259df1cf19 on hv-cinder-80295 Aug 05 14:32:26.767260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-d8d8309d-60c1-45e5-ae34-a7c96a0e036e req-d9fcacb3-431f-489e-a01c-443da8b97978 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030376 Aug 05 14:32:26.767842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 327/653] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:27.123321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:27.124104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:27.131112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:27.131715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:27.132216 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:27.133067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:27.133584 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:27.134012 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:27.267317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:27.275327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a549777a-e48f-446e-8907-43d9802e5dca tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.155955 Aug 05 14:32:27.275880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 327/654] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:27 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:27.632550 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:27.633325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:27.639253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:27.639731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:27.640164 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:27.640918 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:27.644211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:27.644211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:27.674484 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:27.674954 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:27.675378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:27.675896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lazy-loading 'fault' on Instance uuid 145b6612-d562-4fb1-8ef7-35259df1cf19 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:32:27.717644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d62fe4e6de4308a3a51be3e900625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725df4ddc2b4ec8accc5b0bd7b39a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:27.725768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f7824e09-0efb-4b79-b713-0223bac5f963 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 200 len: 1311 microversion: 2.1 time: 0.099130 Aug 05 14:32:27.726343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 328/655] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:27 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:28.295078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:28.295690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:28.302811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:28.303287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:28.303718 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:28.304397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:28.304874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:28.305294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:28.435521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:28.443880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-15c1c30c-6a3f-4d10-87da-c2820aa22ed6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.152629 Aug 05 14:32:28.444460 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 328/656] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:28 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:28.746348 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:28.746963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] [instance: 145b6612-d562-4fb1-8ef7-35259df1cf19] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:28.753419 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:28.753903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:28.754342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:28.755037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:28.755527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:28.755953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:28.768908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] HTTP exception thrown: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 could not be found. Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Request method failure captured: Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 HTTP/1.1 Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShLeOGY3xgmoxbysO01GVLxdm7-SDIsutDqL0n72iPn3pT8haewb_NYOn5hSSjZT_Kt7bqRoRNgPeDTj8F0yshVjFRjQGjqPhSmi02yVuH86Bz5hiIYU6x0rFEYBr-JrCmCoIIVKx0jXYhc2ruelY7owXiKVaN8ma1VXdN7I8OpDzw Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:32:28.770626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8725df4ddc2b4ec8accc5b0bd7b39a49", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8725df4ddc2b4ec8accc5b0bd7b39a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 8725df4ddc2b4ec8accc5b0bd7b39a49 Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755543105 Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: b9d62fe4e6de4308a3a51be3e900625f Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755543105-project Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 could not be found. Aug 05 14:32:28.772157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '145b6612-d562-4fb1-8ef7-35259df1cf19'} Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 could not be found. Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:32:28.773076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 could not be found. Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 could not be found. Aug 05 14:32:28.774545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:28.775874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] Returning 404 to user: Instance 145b6612-d562-4fb1-8ef7-35259df1cf19 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:32:28.775874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-adeb6ac4-3b63-43af-a535-b20897828350 tempest-ServerRescueNegativeTestJSON-755543105 tempest-ServerRescueNegativeTestJSON-755543105-project] 10.222.0.26 "GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19" status: 404 len: 111 microversion: 2.1 time: 0.029608 Aug 05 14:32:28.775874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 329/657] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:28 2022] GET /compute/v2.1/servers/145b6612-d562-4fb1-8ef7-35259df1cf19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:32:29.464519 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:29.465281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:29.471549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:29.472106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:29.472575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:29.473406 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:29.473895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:29.474318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:29.608757 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:29.616688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-160d27c2-3e61-48b1-b6dc-63a6d383d41d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.155965 Aug 05 14:32:29.617261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 329/658] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:29 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:30.520782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:30.523065 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:30.534067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:30.534766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:30.536095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:30.537209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:30.537884 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:30.538489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:30.573110 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-04430d39-3ca8-42ba-a523-52ef30f1bf83 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056813 Aug 05 14:32:30.573671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 330/659] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:32:30 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:32:30.642299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:30.642494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:30.642948 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:30.643062 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:30.646501 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:30.647249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:30.647898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:30.648033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:30.648643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:30.649158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:30.649580 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:30.650003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:30.650423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:30.650562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:30.651037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:30.651364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:30.697968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:32:30.841501 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:30.850388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-feb60c1c-63dc-45fd-bad1-63d6e33c6416 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.215652 Aug 05 14:32:30.850988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 330/660] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:30 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:30.987074 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-33d195be-0cb2-4c6f-9baf-bf10730b6861 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 204 len: 0 microversion: 2.1 time: 0.352145 Aug 05 14:32:30.991785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 331/661] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:32:30 2022] DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:32:30.997334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:30.998176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:31.004923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:31.005421 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:31.005859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:31.006561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:31.007246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:31.007671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:31.202535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:31.210888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1e7a9510-ce05-4ba0-a638-55430a7fd4e3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1674 microversion: 2.1 time: 0.217535 Aug 05 14:32:31.211466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 331/662] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:30 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:31.873097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:31.873789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:31.882081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:31.882654 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:31.883084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:31.883762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:31.884210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:31.884655 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:32.110265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:32.118753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2bac770b-9f86-49b6-8636-db3597dc5b7d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.249822 Aug 05 14:32:32.119325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 332/663] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:31 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:32.232778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:32.233487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:32.240435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:32.240933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:32.241373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:32.242067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:32.242527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:32.242949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:32.407591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:32.415574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e4675e59-b3fe-40ee-90cc-50bdcf86f85e tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1674 microversion: 2.1 time: 0.186747 Aug 05 14:32:32.416237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 332/664] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:32 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:33.141521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:33.142245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:33.149799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:33.150283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:33.150738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:33.151435 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:33.151879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:33.152295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:33.294852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:33.303121 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9c790850-7468-404b-8329-d4989f22aea3 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.165427 Aug 05 14:32:33.303708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 333/665] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:33 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:33.436864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:33.437577 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:33.444388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:33.454725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:33.455677 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:33.456870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:33.457862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:33.458286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:33.597306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:33.605429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e8c46873-6a6b-4cbe-bbda-b39573f72d80 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1674 microversion: 2.1 time: 0.172430 Aug 05 14:32:33.606004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 333/666] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:33 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:34.029722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-7aee2c77-5511-406f-aef5-2afdd1404608 req-3a73c397-92ec-4fbe-a519-cc5f8652f6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a17e392-41cb-4261-94a6-5f144eefe190", "name": "network-vif-deleted", "tag": "d2c9fb6e-8b73-4b73-b212-e026732f6ed6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:34.042019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-7aee2c77-5511-406f-aef5-2afdd1404608 req-3a73c397-92ec-4fbe-a519-cc5f8652f6c5 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:34.042936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-7aee2c77-5511-406f-aef5-2afdd1404608 req-3a73c397-92ec-4fbe-a519-cc5f8652f6c5 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:34.043630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-7aee2c77-5511-406f-aef5-2afdd1404608 req-3a73c397-92ec-4fbe-a519-cc5f8652f6c5 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:34.058419 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-7aee2c77-5511-406f-aef5-2afdd1404608 req-3a73c397-92ec-4fbe-a519-cc5f8652f6c5 service nova] Creating event network-vif-deleted:d2c9fb6e-8b73-4b73-b212-e026732f6ed6 for instance 0a17e392-41cb-4261-94a6-5f144eefe190 on hv-cinder-80295 Aug 05 14:32:34.064701 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-7aee2c77-5511-406f-aef5-2afdd1404608 req-3a73c397-92ec-4fbe-a519-cc5f8652f6c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Aug 05 14:32:34.065528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 334/667] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:32:34.323703 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:34.324553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:34.330697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:34.331015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:34.331460 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:34.332376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:34.332865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:34.333404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:34.521531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:34.529904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7c7dab7b-25b8-4e49-8c2f-f41ded672750 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.209838 Aug 05 14:32:34.530994 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 334/668] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:34 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:34.628054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:34.628787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:34.635209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:34.635697 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:34.636140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:34.636861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:34.637319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:34.637740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:34.673681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:34.674079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:34.674704 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:34.675337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lazy-loading 'fault' on Instance uuid 0a17e392-41cb-4261-94a6-5f144eefe190 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:32:34.720011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:34.730706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b916091d-e8f9-4cc9-aef1-e572ae0e35cc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 200 len: 1328 microversion: 2.1 time: 0.107251 Aug 05 14:32:34.744440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 335/669] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:34 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:35.551229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:35.551964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:35.558369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:35.558850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:35.559287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:35.559971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:35.560453 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:35.560882 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:35.734039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:35.742501 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0712ef64-8960-4e08-8ae3-42cfcb539dbc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.195158 Aug 05 14:32:35.743079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 335/670] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:35 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:35.752712 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:35.758043 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:35.760382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:35.760896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:35.761328 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:35.762010 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:35.762491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:35.762919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:35.776131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] HTTP exception thrown: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Request method failure captured: Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 HTTP/1.1 Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShVdzmCVe7BTn24jwUZMBy1uUx8-eom23N53JXAzgr683jiOUyM60O_44xB4GH90y5dEMDluZQHNS4VHLPwSj70bLSFjZNJTj2DXranf1a3ri5tmwIFP5gjZ5Tf8YllyLeqKvztrZ8hpWw3MuQt2FRHw9Hjcquj3agVIugFvzUYklY Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:32:35.777772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b15967673f14cf9a208a6143a4e87cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 99dc94fff06f42c39f3750484f6d8e9d Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:32:35.779318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '0a17e392-41cb-4261-94a6-5f144eefe190'} Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:32:35.785156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:32:35.786932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:32:35.788237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Returning 404 to user: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:32:35.788237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-63e848d9-f036-4786-a0ce-2c652e181e0a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 404 len: 111 microversion: 2.1 time: 0.030261 Aug 05 14:32:35.788237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 336/671] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:35 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:32:35.788521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-098068e5-346f-4333-b4eb-4f832d5737cf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '.version_select at 0x7fa75d187b80>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:35.881114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-098068e5-346f-4333-b4eb-4f832d5737cf tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188781242" status: 202 len: 0 microversion: 2.1 time: 0.096893 Aug 05 14:32:35.881801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 336/672] 10.222.0.26 () {58 vars in 1221 bytes} [Fri Aug 5 14:32:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188781242 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:32:36.688769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-441d1052-44bb-422d-8111-c18b67d267e8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: .version_select at 0x7fa75e364550>, body: {"keypair": {"name": "tempest-keypair-1178551274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqmwXRClh7l7Uqc8vXvdU/fm2JRA3x/Fn0PgGG00Ej3d4c9AykuJlrCPU/bjQqmTFWi0P/15HeVyo0+PUUiOLofsEcv9OULxPpxLEN95ajE05pRXvPElbaxbVgA8K8sOQ=="}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:36.709993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-441d1052-44bb-422d-8111-c18b67d267e8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:32:36.714246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-441d1052-44bb-422d-8111-c18b67d267e8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for user 99dc94fff06f42c39f3750484f6d8e9d and project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:32:36.764329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:36.765113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:36.771791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:36.773198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:36.773721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:36.774557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:36.775077 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:36.775783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:36.825144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-441d1052-44bb-422d-8111-c18b67d267e8 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140090 Aug 05 14:32:36.826122 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 337/673] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:32:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:36.943641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:36.953129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b7302466-eb84-4cdb-92a4-4052f3e2a796 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.193829 Aug 05 14:32:36.953712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 337/674] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:36 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:37.975319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:37.976032 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:37.983088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:37.991229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:37.991229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:37.991229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:37.991229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:37.991671 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:38.216842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:38.219843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:38.226435 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9249851f-b5d3-4d61-99d2-51b7875a59f6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.255966 Aug 05 14:32:38.227475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 338/675] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:37 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:39.254888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:39.256560 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:39.264700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:39.265608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:39.266271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:39.267119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:39.267722 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:39.268550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:39.287756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-694786295", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "275d8efb-e4f4-42a1-a3d7-242f88553872"}], "security_groups": [{"name": "tempest-securitygroup--1739179079"}], "key_name": "tempest-keypair-1178551274", "user_data": "}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:39.518035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] validate_networks() for [('275d8efb-e4f4-42a1-a3d7-242f88553872', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:32:39.528186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:39.537219 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0c73e83a-7ceb-409c-9307-a88f5c8e261c tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.288744 Aug 05 14:32:39.538848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 338/676] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:39 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:40.028907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:32:40.029340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:32:40.029817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:32:40.030230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:32:40.030644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:32:40.039961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:40.040469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:40.040908 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:40.041674 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:40.042139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:40.042589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:40.059857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:32:40.063900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Getting quotas for user 99dc94fff06f42c39f3750484f6d8e9d and project 0b15967673f14cf9a208a6143a4e87cc. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:32:40.075017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:32:40.083236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:32:40.204949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-30310568-f1de-4ee8-a0d4-cc0991aad0a0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.925139 Aug 05 14:32:40.204949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 339/677] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:32:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 14:32:40.215521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2484c1c3-8a56-4599-9309-6f619e49bbeb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:40.216137 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2484c1c3-8a56-4599-9309-6f619e49bbeb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:40.282762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2484c1c3-8a56-4599-9309-6f619e49bbeb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:40.289682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2484c1c3-8a56-4599-9309-6f619e49bbeb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1237 microversion: 2.1 time: 0.078135 Aug 05 14:32:40.290357 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 339/678] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:40 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:40.560893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:40.561553 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:40.568707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:40.569188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:40.569620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:40.570324 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:40.570777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:40.571194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:40.731474 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:40.739570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8fda1829-265d-4843-b41a-864e4bd9615f tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.183175 Aug 05 14:32:40.740129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 340/679] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:40 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:41.310323 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:41.311034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:41.313448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:41.319644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:41.320221 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:41.320764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:41.321535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:41.322067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:41.322551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:41.400302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:41.408402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7d7abd2f-72c3-4df3-80e7-1a7d9ca2ed16 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1241 microversion: 2.1 time: 0.102110 Aug 05 14:32:41.409001 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 340/680] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:41 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:41.760753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:41.761367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:41.767713 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:41.768242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:41.768689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:41.769380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:41.770394 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:41.770956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:41.905480 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:41.913932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-59193fc8-8ea1-4cfc-ba0f-eba521bfc598 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.157032 Aug 05 14:32:41.914505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 341/681] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:41 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:42.429761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:42.430375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:42.436965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:42.437450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:42.437886 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:42.438572 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:42.439031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:42.439451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:42.502599 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:42.510955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0dbac730-1bab-459c-a348-9d6f22bc78f3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1297 microversion: 2.1 time: 0.085563 Aug 05 14:32:42.511852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 341/682] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:42 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:42.935300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:42.935913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:42.937789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:42.943139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:42.943670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:42.944047 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:42.944753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:42.945204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:42.945620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.090764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:43.100646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9039609d-8cf1-479f-8bef-0b58881baf35 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1508 microversion: 2.1 time: 0.169276 Aug 05 14:32:43.111556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 342/683] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:42 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:43.121723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:43.122335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:43.128457 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:43.130954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:43.130954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.131309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:43.131926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:43.132526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.176313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118053) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 14:32:43.262394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:43.487609 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d7beab2e-fac7-40f7-a41e-ec0e0321ecc6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "POST /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe/action" status: 202 len: 0 microversion: 2.1 time: 0.370436 Aug 05 14:32:43.492161 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 342/684] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:32:43 2022] POST /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:32:43.496849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:43.497492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:43.509935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:43.509935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:43.510264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.510925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:43.511381 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:43.511804 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.535391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:43.536531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:43.545320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:43.546122 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:43.546666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.547585 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:43.548125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:43.548722 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:43.828373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:43.839743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f3587108-9bed-4261-a24d-205421a5a529 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1516 microversion: 2.1 time: 0.346663 Aug 05 14:32:43.858842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 343/685] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:43 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1516 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:43.876474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:43.882325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3288a198-335b-41b8-8441-c8bc97975c10 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.352578 Aug 05 14:32:43.896474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 343/686] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:43 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:44.361720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-f08a097c-f9fc-487d-a88c-01f194f6bdc2 req-32c08522-bda8-4a0f-8df7-2feaab4f73c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfcb42f-4569-4f50-a12d-ee7bf900ada5", "tag": "38712c42-840e-4978-b958-8bd8cc5562cc"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:44.372940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f08a097c-f9fc-487d-a88c-01f194f6bdc2 req-32c08522-bda8-4a0f-8df7-2feaab4f73c1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:44.373822 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f08a097c-f9fc-487d-a88c-01f194f6bdc2 req-32c08522-bda8-4a0f-8df7-2feaab4f73c1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:44.373950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f08a097c-f9fc-487d-a88c-01f194f6bdc2 req-32c08522-bda8-4a0f-8df7-2feaab4f73c1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:44.385533 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-f08a097c-f9fc-487d-a88c-01f194f6bdc2 req-32c08522-bda8-4a0f-8df7-2feaab4f73c1 service nova] Creating event network-changed:38712c42-840e-4978-b958-8bd8cc5562cc for instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 on hv-cinder-80295 Aug 05 14:32:44.390441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-f08a097c-f9fc-487d-a88c-01f194f6bdc2 req-32c08522-bda8-4a0f-8df7-2feaab4f73c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032558 Aug 05 14:32:44.391060 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 344/687] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:44.852811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-62063da9-5902-414e-82eb-803f2b0ed697 req-228ec809-893d-4a3b-9410-8157e79d2353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "name": "network-vif-unplugged", "status": "completed", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:44.868234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:44.869097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:44.875913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-62063da9-5902-414e-82eb-803f2b0ed697 req-228ec809-893d-4a3b-9410-8157e79d2353 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:44.876397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-62063da9-5902-414e-82eb-803f2b0ed697 req-228ec809-893d-4a3b-9410-8157e79d2353 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:44.877030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-62063da9-5902-414e-82eb-803f2b0ed697 req-228ec809-893d-4a3b-9410-8157e79d2353 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:44.878598 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:44.882938 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:44.883278 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:44.884174 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:44.885088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:44.885762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:44.892691 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.compute.server_external_events [req-62063da9-5902-414e-82eb-803f2b0ed697 req-228ec809-893d-4a3b-9410-8157e79d2353 service nova] Unable to find a host for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe. Dropping event network-vif-unplugged {{(pid=118053) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 14:32:44.892691 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-62063da9-5902-414e-82eb-803f2b0ed697 req-228ec809-893d-4a3b-9410-8157e79d2353 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043927 Aug 05 14:32:44.893298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 344/688] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 14:32:44.907307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:44.908206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:44.923487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:44.928322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:44.929034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:44.929783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:44.930255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:44.930689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:45.114458 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:45.121834 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-20561c78-c6ad-4e8b-b943-2d83871b45e9 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1518 microversion: 2.1 time: 0.258897 Aug 05 14:32:45.122422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 345/689] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:44 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:45.137458 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:45.145432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-10b9ed86-68a4-4877-a043-d676ffe102f7 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.241629 Aug 05 14:32:45.148386 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 345/690] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:44 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:46.142767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:46.143382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:46.150207 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:46.150696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:46.151135 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:46.151830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:46.152287 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:46.152740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:46.167192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:46.168609 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:46.175009 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:46.175853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:46.176514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:46.177536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:46.178586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:46.179207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:46.356831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:46.361889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:46.364570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d58c7baa-c2e6-4c9a-a381-23bf0d5caa4a tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1518 microversion: 2.1 time: 0.225494 Aug 05 14:32:46.365149 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 346/691] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:46 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:46.370119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5bb9686e-fe99-43ea-b5f7-bd6f391810ca tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.207828 Aug 05 14:32:46.373367 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 346/692] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:46 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:47.385758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:47.386352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:47.390973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:47.391639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:47.392875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:47.393391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:47.393828 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:47.394518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:47.394999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:47.395420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:47.398717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:47.399351 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:47.399788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:47.400701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:47.401235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:47.404294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:47.592023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:47.600554 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bbe3f9c4-3f62-44bd-93de-6869fd756e95 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1518 microversion: 2.1 time: 0.218856 Aug 05 14:32:47.602024 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 347/693] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:47 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:47.605053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:47.612787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b11db35c-e71d-47c8-b03f-274fc51a9f2d tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.225602 Aug 05 14:32:47.613377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 347/694] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:47 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:48.622989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:48.623694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:48.632046 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:48.632656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:48.633367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:48.634501 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:48.635216 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:48.635709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:48.635872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:48.636613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:48.643302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:48.643882 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:48.644391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:48.645349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:48.645889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:48.646386 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:48.840762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:48.849395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4bdc45c4-4c33-44a6-877e-06b3a13f93ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.230275 Aug 05 14:32:48.849980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 348/695] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:48 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:48.850752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:48.858669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-98e44802-07f8-44cb-8e39-3eab467c63c5 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.227988 Aug 05 14:32:48.859231 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 348/696] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:48 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:49.870583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:49.871230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:49.877772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:49.878252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:49.878680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:49.879145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:49.879559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:49.879784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:49.879884 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:49.880203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:49.886731 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:49.887210 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:49.887649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:49.888327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:49.888803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:49.889223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:50.050523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:50.070991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=10 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:50.076877 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:50.079962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:50.084936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-35ac7956-6ed1-4b9b-9de8-282905a7fb19 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.218812 Aug 05 14:32:50.085605 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 349/697] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:49 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:50.087943 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e3c24b61-8afa-488f-9794-9cd08a0ae2b0 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.212569 Aug 05 14:32:50.088520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 349/698] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:49 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:51.107845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:51.108481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:51.109303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:51.109937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:51.111755 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:51.115358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:51.115847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:51.116282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:51.117177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:51.117366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:51.117551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:51.117817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:51.118607 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:51.119033 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:51.119678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:51.120142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:51.120612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:51.314909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:51.319063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:51.323044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b9251382-09f1-4fa0-8500-0ce5f5d7de40 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.219529 Aug 05 14:32:51.323624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 350/699] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:51 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:51.327355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c5bd5f0e-ec25-4d0f-84ff-3bbeb6ca1fb9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.221864 Aug 05 14:32:51.327914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 350/700] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:51 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:52.344479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:52.345098 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:52.348968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:52.349685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:52.351827 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:52.352386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:52.353391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:52.354127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:52.354579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:52.355001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:52.357140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:52.357590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:52.358026 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:52.358714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:52.359177 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:52.359596 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:52.554855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:52.557885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:52.562632 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-72eea40e-42c2-4151-aec6-1ade4c3d8b1d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.222613 Aug 05 14:32:52.563211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 351/701] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:52 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:52.565435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-298099d2-cffc-4982-a425-55b327450cff tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.220372 Aug 05 14:32:52.566061 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 351/702] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:52 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:53.583749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:53.584284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:53.586383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:53.587656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:53.591751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:53.592243 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:53.592966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:53.593661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:53.594110 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:53.594285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:53.594530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:53.594775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:53.595208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:53.595907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:53.596360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:53.596824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:54.026005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:54.029833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:54.033557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ccc4a786-8611-4f8b-9efd-face1d2a27c9 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.450973 Aug 05 14:32:54.034119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 352/703] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:53 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:54.037456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ba1b4f00-66cc-4f8a-ac26-5711f10103dd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.457638 Aug 05 14:32:54.038022 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 352/704] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:53 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:54.528226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-fc88db6f-c8cc-4d66-b4c5-d23a6e4857b0 req-a73e12e9-e5b6-4543-ad6b-603d42fe85a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfcb42f-4569-4f50-a12d-ee7bf900ada5", "name": "network-vif-plugged", "status": "completed", "tag": "38712c42-840e-4978-b958-8bd8cc5562cc"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:54.537450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-fc88db6f-c8cc-4d66-b4c5-d23a6e4857b0 req-a73e12e9-e5b6-4543-ad6b-603d42fe85a1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:54.537933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-fc88db6f-c8cc-4d66-b4c5-d23a6e4857b0 req-a73e12e9-e5b6-4543-ad6b-603d42fe85a1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:54.538368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-fc88db6f-c8cc-4d66-b4c5-d23a6e4857b0 req-a73e12e9-e5b6-4543-ad6b-603d42fe85a1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:54.549929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-fc88db6f-c8cc-4d66-b4c5-d23a6e4857b0 req-a73e12e9-e5b6-4543-ad6b-603d42fe85a1 service nova] Creating event network-vif-plugged:38712c42-840e-4978-b958-8bd8cc5562cc for instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 on hv-cinder-80295 Aug 05 14:32:54.554864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-fc88db6f-c8cc-4d66-b4c5-d23a6e4857b0 req-a73e12e9-e5b6-4543-ad6b-603d42fe85a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031251 Aug 05 14:32:54.555496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 353/705] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:55.054923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:55.055773 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:55.059914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:55.060784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:55.062634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:55.063121 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:55.063555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:55.064245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:55.064727 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:55.065146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:55.066888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:55.067375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:55.067814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:55.068534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:55.068995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:55.069421 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:55.263902 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:55.268220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:55.271694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-13d957b2-cba9-460f-8a40-0611fce8e518 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.220725 Aug 05 14:32:55.272369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 353/706] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:55 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:55.275754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-666b6a83-cb9b-4660-834e-904b1e3bdf9b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.220620 Aug 05 14:32:55.276387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 354/707] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:55 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:56.292760 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:56.293432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:56.298267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:56.298901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:56.302246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:56.302744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:56.303187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:56.304057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:56.304482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:56.315040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:56.315201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:56.315201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:56.315201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:56.315201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:56.315489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:56.315489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:56.508884 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:56.512002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:56.517002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a28cc39f-f0cd-4cfc-9fd3-5936c5dfb1aa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.223851 Aug 05 14:32:56.520286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 355/708] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:56 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:32:56.520445 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ba91d5cf-ba5d-4426-a3ae-1a6be153967c tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1363 microversion: 2.1 time: 0.231640 Aug 05 14:32:56.520445 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 354/709] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:56 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:57.538977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:57.539513 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:57.539912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:57.540010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:57.545744 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:57.546250 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:57.546536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:57.546669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:57.547139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:57.547343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:57.547702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:57.547802 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:57.548210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:57.548593 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:57.549110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:57.549626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:57.751829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:57.756303 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:57.759892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ccdbe05b-494e-4a34-9e43-34772869e3fa tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.224709 Aug 05 14:32:57.760494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 356/710] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:57 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:57.764950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ce7dc2ad-8e20-4805-909e-187d82a6e6de tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1549 microversion: 2.1 time: 0.229544 Aug 05 14:32:57.775384 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 355/711] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:57 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:57.786717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:57.786717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:57.792082 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:57.793114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:57.793560 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:57.794244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:57.794698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:57.795119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:57.872147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8365632d-95a8-480a-9732-b5a889d34258 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090078 Aug 05 14:32:57.872783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 357/712] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:32:57 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:32:58.781942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:58.782553 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:58.788593 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:58.789079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:58.789505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:58.790195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:58.790642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:58.791067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:58.936114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:32:58.938586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=100 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:32:58.945441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a4ea01c9-fced-4c3f-b562-40b766a224ba tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.168405 Aug 05 14:32:58.947660 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 356/713] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:58 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:32:59.102205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-f38f948c-2949-4bdc-b3a6-4d37dd3b7cae req-51d2717b-46bc-4b15-adbd-a1ecc4e2f55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfcb42f-4569-4f50-a12d-ee7bf900ada5", "tag": "38712c42-840e-4978-b958-8bd8cc5562cc"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:32:59.111841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f38f948c-2949-4bdc-b3a6-4d37dd3b7cae req-51d2717b-46bc-4b15-adbd-a1ecc4e2f55d service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:59.112327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f38f948c-2949-4bdc-b3a6-4d37dd3b7cae req-51d2717b-46bc-4b15-adbd-a1ecc4e2f55d service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:59.112911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-f38f948c-2949-4bdc-b3a6-4d37dd3b7cae req-51d2717b-46bc-4b15-adbd-a1ecc4e2f55d service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:59.125348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-f38f948c-2949-4bdc-b3a6-4d37dd3b7cae req-51d2717b-46bc-4b15-adbd-a1ecc4e2f55d service nova] Creating event network-changed:38712c42-840e-4978-b958-8bd8cc5562cc for instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 on hv-cinder-80295 Aug 05 14:32:59.130693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-f38f948c-2949-4bdc-b3a6-4d37dd3b7cae req-51d2717b-46bc-4b15-adbd-a1ecc4e2f55d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032705 Aug 05 14:32:59.131480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 358/714] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:32:59.968488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:32:59.969925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:32:59.977408 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:59.979190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:59.979190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:32:59.979190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:32:59.979547 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:32:59.980222 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:00.138498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:00.149630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-aabf066d-d448-47f0-a1ae-c51a4a55b801 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.186033 Aug 05 14:33:00.150611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 357/715] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:32:59 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:33:01.172298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:01.173089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:01.179887 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:01.180369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:01.180829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:01.181546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:01.181997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:01.182418 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:01.314354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:01.321879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b1e37f44-7877-43ab-a696-404871f4552d tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.154479 Aug 05 14:33:01.322447 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 359/716] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:33:01 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:33:02.343268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:02.343882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:02.351544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:02.352109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:02.352661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:02.353451 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:02.353970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:02.354460 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:02.490401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:02.498822 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ab408d11-c2b9-4f35-92df-31bbdc908872 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.159626 Aug 05 14:33:02.499404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 358/717] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:33:02 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:33:03.519265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:03.519995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:03.526768 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:03.527255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:03.527688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:03.528551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:03.528901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:03.529322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:03.660618 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:03.662894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:33:03.669839 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-94c31088-57a9-4a79-a8b9-6516edeb5a63 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.154528 Aug 05 14:33:03.670429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 360/718] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:33:03 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:33:04.487750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-81c99de9-9ead-4fa2-934a-fca72a56becd req-2ce3bf31-3534-42b6-8a04-cac8a755f796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "name": "network-vif-plugged", "status": "completed", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:33:04.498198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-81c99de9-9ead-4fa2-934a-fca72a56becd req-2ce3bf31-3534-42b6-8a04-cac8a755f796 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:04.498746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-81c99de9-9ead-4fa2-934a-fca72a56becd req-2ce3bf31-3534-42b6-8a04-cac8a755f796 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:04.499175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-81c99de9-9ead-4fa2-934a-fca72a56becd req-2ce3bf31-3534-42b6-8a04-cac8a755f796 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:04.512793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-81c99de9-9ead-4fa2-934a-fca72a56becd req-2ce3bf31-3534-42b6-8a04-cac8a755f796 service nova] Creating event network-vif-plugged:8b771fe9-cb75-4a40-83f5-e824ba468b93 for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe on hv-cinder-80295 Aug 05 14:33:04.518002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-81c99de9-9ead-4fa2-934a-fca72a56becd req-2ce3bf31-3534-42b6-8a04-cac8a755f796 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034410 Aug 05 14:33:04.518792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 359/719] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:33:04.692046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:04.692688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:04.700111 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:04.700631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:04.701061 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:04.701744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:04.702194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:04.702646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:04.846257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:04.854709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e7f5c5e0-ccff-4540-ae70-a2ff1a001db1 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.166812 Aug 05 14:33:04.855605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 361/720] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:33:04 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:33:06.033890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:06.034618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:06.040765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:06.041242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:06.041675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:06.042360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:06.042812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:06.043229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:06.172942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:06.180459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f45a1554-f1be-4a3b-a10d-f05ed936c870 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1574 microversion: 2.1 time: 0.307537 Aug 05 14:33:06.181026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 360/721] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:33:05 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1574 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:33:07.201341 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:07.201953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:07.208368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:07.208890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:07.209327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:07.210014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:07.210472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:07.210892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:07.344128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:07.351628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-14680934-debf-4c0d-92ff-684a9a1233b6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1561 microversion: 2.1 time: 0.154203 Aug 05 14:33:07.352230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 362/722] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:33:07 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:33:47.988066 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:47.989387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:47.991584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=37 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:33:47.992770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=21 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:33:47.997619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:47.998803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:47.998803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:47.999202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:47.999657 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:48.000078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:48.025347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-178fb316-a324-4480-bfd6-c8588cc2fd4a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/ips" status: 200 len: 151 microversion: 2.20 time: 0.041286 Aug 05 14:33:48.025990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 361/723] 10.222.0.26 () {60 vars in 1289 bytes} [Fri Aug 5 14:33:47 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 14:33:50.211917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:33:50.212575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:50.214752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:33:50.215536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=13 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:33:50.220436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:50.220947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:50.221381 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:50.222072 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:50.222524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:50.222946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:50.246540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lazy-loading 'flavor' on Instance uuid 990c9dca-a1be-4bf2-9015-e4f83ddf357c {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:33:50.687196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f0291a8f-f0d3-46c4-b6da-9170fbad39b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/action" status: 202 len: 0 microversion: 2.20 time: 0.479808 Aug 05 14:33:50.687800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 363/724] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Aug 5 14:33:50 2022] POST /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:33:50.696921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:50.698029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:50.706086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:50.706658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:50.707184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:50.708094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:50.708724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:50.709265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:50.856753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:50.865928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:50.867601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:50.868796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bc3c0072-c127-46fd-bd4c-850b2003b23a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.176729 Aug 05 14:33:50.869469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 362/725] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:50 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:51.893498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:51.894332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:51.901244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:51.901800 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:51.902239 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:51.902931 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:51.903383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:51.903926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:52.040058 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:52.047816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:52.049565 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:52.050509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f7044544-1283-4282-aeec-a9800b9aa69d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.161971 Aug 05 14:33:52.051079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 364/726] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:51 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:53.079995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:53.080634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:53.087478 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:53.087968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:53.088464 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:53.089171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:53.089634 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:53.090062 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:53.218480 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:53.226837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:53.228344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:53.229536 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-eab2661a-11d0-4b42-a13d-6c1dc6bc4715 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.153505 Aug 05 14:33:53.230114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 363/727] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:53 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:54.252918 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:54.253558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:54.259884 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:54.260366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:54.260834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:54.261522 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:54.261975 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:54.262401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:54.393116 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:54.401763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:54.403333 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:54.404562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fa201157-8297-45e9-8afb-98e4a892f071 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.155515 Aug 05 14:33:54.405133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 365/728] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:54 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:55.427913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:55.428539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:55.435604 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:55.436081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:55.436542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:55.437233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:55.437683 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:55.438096 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:55.567846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:55.576044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:55.577563 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:55.578701 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-df82c139-4a32-4c15-94b3-3c510f6c61b9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.154709 Aug 05 14:33:55.579257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 364/729] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:55 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:56.602911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:56.603432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:56.612698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:56.612698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:56.612698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:56.612698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:56.613090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:56.613090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:56.746491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:56.754612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:56.756174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:56.757792 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-865e6121-3da6-4d82-af4b-22007679b58d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.159743 Aug 05 14:33:56.758360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 366/730] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:56 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:57.781009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:57.781618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:57.788053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:57.788732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:57.793491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:57.793491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:57.793491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:57.793491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:57.923179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:57.932524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:57.934185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:57.935414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9123079a-bcb1-463f-8db4-67c25d54244b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.158312 Aug 05 14:33:57.935977 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 365/731] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:57 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:33:58.958864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:33:58.959470 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:33:58.966955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:58.967506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:58.967950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:58.969003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:33:58.969538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:33:58.969969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:33:59.100485 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:59.108673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:59.110220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:33:59.111385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-64485f3c-2ffe-41c2-8eb4-52acbbd2a75c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.156444 Aug 05 14:33:59.111969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 367/732] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:33:58 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:00.134233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:00.134805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:00.141311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:00.141798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:00.142231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:00.142920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:00.143380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:00.143793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:00.277769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:00.285763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:00.287296 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:00.288452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a7960c6a-a5a6-4639-8794-f2a80a503b30 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.158401 Aug 05 14:34:00.289689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 366/733] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:00 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:01.313279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:01.313820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:01.320209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:01.320714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:01.321148 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:01.321872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:01.322661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:01.323158 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:01.451835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:01.460395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:01.461910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:01.463157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6c926ce2-7e71-4895-973b-63b17f3a4104 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.153839 Aug 05 14:34:01.463725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 368/734] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:01 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:02.486718 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:02.487329 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:02.493730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:02.494211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:02.494649 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:02.495574 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:02.496033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:02.496485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:02.631315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:02.640062 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:02.641608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:02.642777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-879eab99-a313-4df9-a0d5-b9b84244789b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1744 microversion: 2.20 time: 0.160065 Aug 05 14:34:02.643391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 367/735] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:02 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:03.667929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:03.668638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:03.678184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:03.678184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:03.678184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:03.678184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:03.678489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:03.678489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:03.813117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:03.821158 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:03.822633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:03.823789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c74574c3-fa4e-46f7-84ea-00ac9cecec75 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1744 microversion: 2.20 time: 0.160602 Aug 05 14:34:03.824345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 369/736] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:03 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:04.851753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:04.851753 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:04.859367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:04.859904 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:04.860340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:04.861071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:04.861504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:04.861918 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:05.005593 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:05.015542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:05.017276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:05.018471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bae28d68-2c74-4afe-a0d4-3d051a3baf77 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1744 microversion: 2.20 time: 0.175576 Aug 05 14:34:05.019029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 368/737] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:04 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:06.041808 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:06.043276 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:06.049739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:06.050233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:06.050673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:06.051368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:06.051854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:06.052285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:06.184136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:06.192214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:06.193795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:06.194965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fc04eb7c-fc7c-48f8-a087-b495b2a8e772 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1744 microversion: 2.20 time: 0.157010 Aug 05 14:34:06.195520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 370/738] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:06 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:06.834214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-24b1557b-5057-4f56-9b39-8211179576dd req-64b172fc-3ec6-48cd-a194-d239069955b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "name": "network-vif-plugged", "status": "completed", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:06.846193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-24b1557b-5057-4f56-9b39-8211179576dd req-64b172fc-3ec6-48cd-a194-d239069955b7 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:06.846673 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-24b1557b-5057-4f56-9b39-8211179576dd req-64b172fc-3ec6-48cd-a194-d239069955b7 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:06.847099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-24b1557b-5057-4f56-9b39-8211179576dd req-64b172fc-3ec6-48cd-a194-d239069955b7 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:06.859194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-24b1557b-5057-4f56-9b39-8211179576dd req-64b172fc-3ec6-48cd-a194-d239069955b7 service nova] Creating event network-vif-plugged:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:34:06.864400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-24b1557b-5057-4f56-9b39-8211179576dd req-64b172fc-3ec6-48cd-a194-d239069955b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Aug 05 14:34:06.865385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 369/739] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:07.219089 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:07.219789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:07.226098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:07.226622 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:07.227068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:07.227771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:07.228233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:07.228692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:07.364391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:07.372966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:07.377002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:07.377002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9ec6e838-d189-46fa-84c3-95fc1bb7285b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1744 microversion: 2.20 time: 0.161808 Aug 05 14:34:07.377002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 371/740] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:07 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:08.399391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:08.400097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:08.407906 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:08.408579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:08.409037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:08.409821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:08.410336 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:08.410840 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:08.594584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:08.602410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:08.603850 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:08.605667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-fa49896f-3b0f-4b09-9a21-70b525c69939 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.210617 Aug 05 14:34:08.606512 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 370/741] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:08 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:09.631986 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:09.633801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:09.642192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:09.643031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:09.643698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:09.644643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:09.645320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:09.645966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:09.844751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:09.854600 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:09.859991 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:09.863879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6d336b26-3ad6-4259-9c67-2f84e674ab97 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.236444 Aug 05 14:34:09.867267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 372/742] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:09 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:10.899012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:10.899012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:10.900883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:10.902094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:10.902638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:10.903545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:10.904072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:10.904606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:11.053830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:11.070319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:11.071854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:11.073732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-07fe246a-019b-42cd-b12b-91b02759fe06 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.187283 Aug 05 14:34:11.074378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 371/743] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:10 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:12.098308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:12.099150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:12.107401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:12.107893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:12.108742 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:12.109552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:12.110027 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:12.110443 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:12.272941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:12.286327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:12.288199 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:12.289486 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cb03ada1-974d-43c2-badc-b2b4070c3818 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.196286 Aug 05 14:34:12.290378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 373/744] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:12 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:13.316874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:13.318079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:13.325116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:13.325854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:13.326290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:13.327153 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:13.327763 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:13.328330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:13.519227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:13.530135 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:13.532452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:13.549803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-20d8f283-9f8c-4bc6-aef8-29ba11e1205f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.220723 Aug 05 14:34:13.549803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 372/745] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:13 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:14.556747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:14.557505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:14.568548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:14.569365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:14.569865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:14.571166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:14.571936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:14.572579 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:14.739350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:14.749714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:14.751512 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:14.752711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f7316128-95e0-4467-af40-5cc72909e4b0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.199786 Aug 05 14:34:14.757040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 374/746] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:14 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:15.779014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:15.779615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:15.786150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:15.786829 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:15.787482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:15.788326 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:15.788792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:15.789217 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:15.943517 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:15.952808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:15.954036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:15.955206 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7aeac13a-d695-42d1-854a-4b7d6baf07ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.180884 Aug 05 14:34:15.955770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 373/747] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:15 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:16.979950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:16.980746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:16.987415 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:16.988104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:16.988834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:16.990152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:16.990774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:16.991213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:17.197287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:17.209038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:17.211194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:17.212665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0fa6738e-49a7-4fff-bcda-bec8520e5b65 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.237017 Aug 05 14:34:17.231279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 375/748] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:16 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:18.238812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:18.240848 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:18.252762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:18.255773 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:18.256461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:18.257531 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:18.258195 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:18.258808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:18.486455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:18.500617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:18.515362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:18.518379 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5d6844a9-950c-43b2-b8de-d487a6580130 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.282974 Aug 05 14:34:18.519174 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 374/749] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:18 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:19.543486 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:19.544112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:19.550624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:19.551115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:19.551558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:19.552257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:19.552911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:19.553557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:19.741220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:19.748276 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:19.750112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:19.751310 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5a5b86ba-9cce-48f7-b91c-60410605e72a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.212445 Aug 05 14:34:19.752698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 376/750] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:19 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:20.775537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:20.776883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:20.779557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=29 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:20.785875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:20.785875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:20.785875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:20.786500 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:20.786808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:20.787261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:20.791583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=79 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:21.060137 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:21.070799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:21.074603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:21.077526 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c976462d-a95a-469b-8c55-78aca1fabc3e tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1739 microversion: 2.20 time: 0.305737 Aug 05 14:34:21.078970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 375/751] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:20 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:22.101916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:22.102627 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:22.118099 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=29 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:22.119775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:22.120345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:22.124020 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:22.125000 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:22.125505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:22.131589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:22.153559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:22.301524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:22.313437 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:22.314942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:22.316104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ee54bc4a-a8a9-43a7-ad31-b4e855e64b2a tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1721 microversion: 2.20 time: 0.218344 Aug 05 14:34:22.324840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 377/752] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:22 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:23.348492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:23.349032 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:23.358345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:23.358832 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:23.359323 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:23.359971 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:23.360434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:23.360881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:23.518991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:23.528269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:23.529899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:23.531155 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-813eb8c8-0a16-43c3-bf76-84bfa91d61e6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1721 microversion: 2.20 time: 0.187405 Aug 05 14:34:23.531824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 376/753] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:23 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:24.555017 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:24.556186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:24.565128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:24.569607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:24.570225 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:24.571145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:24.571756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:24.575083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:24.821574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:24.831702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:24.833742 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:24.835133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6566f0b5-d7c9-4d7f-abd2-c68220cf3cd0 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1721 microversion: 2.20 time: 0.284322 Aug 05 14:34:24.836349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 378/754] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:24 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:25.150976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-dd35ef3d-8562-4fe3-bbb1-82ce71ef930c req-62f723a9-3e89-4075-a74a-084be76d80fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "name": "network-vif-unplugged", "status": "completed", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:25.175926 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-dd35ef3d-8562-4fe3-bbb1-82ce71ef930c req-62f723a9-3e89-4075-a74a-084be76d80fa service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:25.176633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-dd35ef3d-8562-4fe3-bbb1-82ce71ef930c req-62f723a9-3e89-4075-a74a-084be76d80fa service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:25.177233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-dd35ef3d-8562-4fe3-bbb1-82ce71ef930c req-62f723a9-3e89-4075-a74a-084be76d80fa service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:25.199132 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-dd35ef3d-8562-4fe3-bbb1-82ce71ef930c req-62f723a9-3e89-4075-a74a-084be76d80fa service nova] Creating event network-vif-unplugged:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:34:25.205642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-dd35ef3d-8562-4fe3-bbb1-82ce71ef930c req-62f723a9-3e89-4075-a74a-084be76d80fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057811 Aug 05 14:34:25.206879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 377/755] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:25.860189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:25.860852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:25.867672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:25.868165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:25.868833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:25.869743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:25.870230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:25.880154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:26.113346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:26.123003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:26.125182 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:26.129942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-53900c18-9ef1-47e0-aea7-2d752dc65eb9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1724 microversion: 2.20 time: 0.270464 Aug 05 14:34:26.129942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 379/756] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:25 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:26.155665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ec67ba6-6ca8-43de-a480-27325c99e324"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:26.160731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:26.166770 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:26.167570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:26.168228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:26.169034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:26.169646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:26.170178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:27.376556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-762ca096-400b-44f8-b3bf-3f91606533d9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.227192 Aug 05 14:34:27.377315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 378/757] 10.222.0.26 () {62 vars in 1364 bytes} [Fri Aug 5 14:34:26 2022] POST /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-volume_attachments => generated 188 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 14:34:27.530456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:27.531029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:27.537267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:27.537749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:27.538179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:27.538927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:27.539388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:27.539811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.188041 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bdcd4b13-510c-4e54-b44f-9094c92d2f44 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-volume_attachments/3ec67ba6-6ca8-43de-a480-27325c99e324" status: 202 len: 0 microversion: 2.20 time: 0.663179 Aug 05 14:34:28.189475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 380/758] 10.222.0.26 () {60 vars in 1457 bytes} [Fri Aug 5 14:34:27 2022] DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-volume_attachments/3ec67ba6-6ca8-43de-a480-27325c99e324 => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:34:28.266741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:28.268077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:28.274714 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:28.275757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:28.276834 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.278035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:28.278668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:28.279242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.317537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118052) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 14:34:28.589222 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8482c963-1265-4def-be40-2f1a8e876074 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "POST /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/action" status: 202 len: 0 microversion: 2.20 time: 0.325971 Aug 05 14:34:28.593293 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 379/759] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Aug 5 14:34:28 2022] POST /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:34:28.604979 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:28.605601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:28.613874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:28.614893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:28.614893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.615663 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:28.616117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:28.617145 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.809965 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:28.810800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:28.821726 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:28.822237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:28.822934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.824400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:28.824888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:28.825320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:28.869698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cce75a3e-891c-4f33-a8fd-9b52460c7a9b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/ips" status: 200 len: 146 microversion: 2.1 time: 0.064483 Aug 05 14:34:28.871115 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 380/760] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:34:28 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/ips => generated 146 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:34:29.148112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:29.157477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:29.161387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:29.163041 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0a9a3cb8-80bb-43ea-a32a-4dc591f02be8 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1672 microversion: 2.20 time: 0.563761 Aug 05 14:34:29.163786 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 381/761] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:28 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1672 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:30.188395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:30.189345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:30.200776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:30.201422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:30.202040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:30.202851 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:30.206124 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:30.206705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:30.364073 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:30.374930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:30.376626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:30.377857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3b6b7eb7-1d64-4317-b793-eaa96f8cff10 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1672 microversion: 2.20 time: 0.194136 Aug 05 14:34:30.389591 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 381/762] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:30 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:30.738706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8804fa37-1fe6-4d3d-af04-f6daeb1d6f98"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:30.741203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:30.758567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:30.759148 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:30.759587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:30.760293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:30.761541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:30.762056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:31.401865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:31.402635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:31.409564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:31.410042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:31.410468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:31.411158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:31.411606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:31.412023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:31.568066 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:31.581130 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f26c8e4b-b8bb-4797-99ab-5c62a009fd84 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846691 Aug 05 14:34:31.582125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 382/763] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:34:30 2022] POST /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:31.584715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:31.595034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:31.595034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-168a2dc7-7709-4b8d-976a-4bdb2598ea91 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.193951 Aug 05 14:34:31.595034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 382/764] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:31 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:32.621303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:32.623036 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:32.631650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:32.640170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:32.640715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:32.647771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:32.648254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:32.648728 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:32.843298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:32.852193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:32.853730 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:32.856167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-149eef12-27f7-4c8a-a010-70123ae0a4f1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.241804 Aug 05 14:34:32.862806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 383/765] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:32 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:33.895669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:33.896276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:33.924613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:33.925292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:33.925743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:33.926485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:33.926936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:33.927370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:34.133316 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:34.143088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:34.145057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:34.146410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-351ee45d-f6a5-4568-97e8-6df8eb8788e9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.261124 Aug 05 14:34:34.147203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 383/766] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:33 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:35.172309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:35.173008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:35.186501 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:35.191516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:35.193488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:35.198537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:35.204784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:35.205205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:35.481872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:35.499170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:35.501229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:35.504507 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5f11d7b6-f6e5-4c38-8120-46678b2abcbd tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.336642 Aug 05 14:34:35.523081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 384/767] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:35 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:36.533285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:36.534027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:36.543294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:36.544012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:36.544675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:36.545606 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:36.546257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:36.546866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:36.790911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:36.799170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:36.800719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:36.801883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c820eaf3-5eec-42cb-baac-02294016baba tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.274609 Aug 05 14:34:36.805737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 384/768] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:36 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:37.833770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:37.835352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:37.842508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:37.843359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:37.844285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:37.845417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:37.846093 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:37.846756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:38.079712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:38.091827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:38.095689 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:38.101741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-afdf8d5a-a1e2-4867-948b-643dba849952 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.272000 Aug 05 14:34:38.119690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 385/769] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:37 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:39.140042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:39.141033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:39.158083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:39.160319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:39.160793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:39.161508 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:39.165181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:39.165883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:39.393124 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:39.404373 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:39.406194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:39.407845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8d454cdc-08b1-442d-b493-bcae2d319587 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.282330 Aug 05 14:34:39.408964 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 385/770] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:39 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:40.439309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:40.439936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:40.452148 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:40.453079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:40.453265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:40.453947 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:40.454436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:40.454912 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:40.627325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:40.635664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:40.637287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:40.638431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-257caa1a-d040-4a15-9546-7345125627d6 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.203168 Aug 05 14:34:40.638992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 386/771] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:40 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:41.669285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:41.674499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:41.676400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:41.676916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:41.677359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:41.678045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:41.678498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:41.678922 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:41.813508 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:41.821504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:41.822996 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:41.824148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4d40a052-8fa3-4f4d-b742-8cb9d0355219 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.159417 Aug 05 14:34:41.824794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 386/772] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:41 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:42.043569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eebe3276-e114-4427-8d16-3006dc67b833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Action: 'create', calling method: .version_select at 0x7fa75d1d71f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-246779284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAv39OKImfnYEqNJLjQHNK310GSQe8IUNvRmk2FUA93Tf23q0it7qXZKxhNQr36A64twfZa8/3C4k7dVqNIoM+B4SfelQrbI0JLv+MH/IbN6W8Sj3E3qaxInDMw4Jpu+Xg=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:42.059573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-eebe3276-e114-4427-8d16-3006dc67b833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Getting quotas for project ca094dd6e4d64383b75640f040744140. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:34:42.063405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-eebe3276-e114-4427-8d16-3006dc67b833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Getting quotas for user 7d37124881084b16a73f5eed20c70940 and project ca094dd6e4d64383b75640f040744140. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:34:42.137855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eebe3276-e114-4427-8d16-3006dc67b833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.098948 Aug 05 14:34:42.138444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 387/773] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:34:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:42.190521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1789021832", "imageRef": "31060f67-f6cb-4482-b6a8-100ac14bec8b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-246779284", "networks": [{"uuid": "a6003aee-cba1-430b-832b-87a39efd461b"}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:42.243289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] validate_networks() for [('a6003aee-cba1-430b-832b-87a39efd461b', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:34:42.607007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:34:42.607429 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:34:42.607899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:34:42.608304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:34:42.608781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:34:42.617534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:42.618017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:42.618452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:42.619173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:42.619661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:42.620088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:42.637213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Getting quotas for project ca094dd6e4d64383b75640f040744140. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:34:42.641276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Getting quotas for user 7d37124881084b16a73f5eed20c70940 and project ca094dd6e4d64383b75640f040744140. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:34:42.653054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:34:42.655898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31060f67-f6cb-4482-b6a8-100ac14bec8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:34:42.795397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a3b3362e-6bba-464d-a607-5a38dfa3f572 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608694 Aug 05 14:34:42.796356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 387/774] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:34:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:34:42.806930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-28a14492-26d0-4f30-8e99-2161073747ae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:42.808241 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-28a14492-26d0-4f30-8e99-2161073747ae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:42.848202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:42.849054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:42.860633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:42.860633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:42.860633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:42.860633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:42.861562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:42.861562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:42.864148 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-28a14492-26d0-4f30-8e99-2161073747ae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:42.873878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-28a14492-26d0-4f30-8e99-2161073747ae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1258 microversion: 2.1 time: 0.070882 Aug 05 14:34:42.874459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 388/775] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:42 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:43.001323 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:43.009205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:43.010969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:43.012104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-953bb4c6-1cb5-4596-8384-8b5a6d1259f3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.168453 Aug 05 14:34:43.012698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 388/776] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:42 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:43.895187 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:43.896195 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:43.902614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:43.903127 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:43.903686 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:43.904373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:43.904851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:43.905272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:43.969114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:43.976298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e8f8e44b-f826-4a63-ba21-8e6a352d3c57 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1262 microversion: 2.1 time: 0.085014 Aug 05 14:34:43.976895 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 389/777] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:43 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:44.035090 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:44.035697 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:44.042614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:44.046467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:44.046467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:44.046467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:44.046467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:44.046833 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:44.175846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:44.178221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:44.185229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:44.186751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:44.187897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a349c1ee-5537-45bf-881c-f26494e840f2 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.156762 Aug 05 14:34:44.188479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 389/778] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:44 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:44.998179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:44.998784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:45.005129 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:45.005608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:45.006039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:45.006717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:45.007180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:45.007585 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:45.069243 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:45.077289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-448f8695-c8f2-4030-b5ef-68ecf5f1ca73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1262 microversion: 2.1 time: 0.083605 Aug 05 14:34:45.077851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 390/779] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:44 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:45.210611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:45.211250 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:45.218898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:45.219382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:45.219817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:45.220537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:45.221033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:45.227510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:45.350702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:45.359106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:45.363262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:45.363262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ea889cf1-3867-4174-a20b-016c0cc74d1c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.155107 Aug 05 14:34:45.363262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 390/780] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:45 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:46.098185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:46.098792 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:46.106135 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:46.106622 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:46.107065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:46.107757 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:46.108218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:46.108683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:46.168498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:46.171916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:46.176179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-29aebff0-2dc5-4b6a-b955-09a0e6c9b99a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1262 microversion: 2.1 time: 0.082318 Aug 05 14:34:46.176793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 391/781] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:46 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:46.386368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:46.387000 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:46.393740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:46.394220 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:46.394654 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:46.395334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:46.395781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:46.396205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:46.527755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:46.535670 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:46.537240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:46.538387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-838520f7-80c0-4750-8e71-ad083e78d1d1 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.156480 Aug 05 14:34:46.538947 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 391/782] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:46 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:47.197509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:47.198277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:47.204900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:47.205384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:47.205829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:47.206488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:47.206936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:47.207351 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:47.268660 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:47.276868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-656ec9bb-345e-4199-a75e-3ab352f134a4 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1262 microversion: 2.1 time: 0.082723 Aug 05 14:34:47.277653 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 392/783] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:47 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:47.561356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:47.561999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:47.568683 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:47.569171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:47.569612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:47.570302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:47.570758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:47.571189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:47.788277 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:47.797560 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:47.799098 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:47.800253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-212e05c5-2d82-408e-85a5-b52b057bfccb tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.243092 Aug 05 14:34:47.800837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 392/784] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:47 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:48.298388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:48.299015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:48.305540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.306096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.306567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:48.307264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.308125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.309466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:48.408661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:48.416176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b4b0b1f7-4d83-47df-9492-8c0085248285 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1310 microversion: 2.1 time: 0.121582 Aug 05 14:34:48.417121 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 393/785] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:48 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1310 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:48.630033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:48.630567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:48.634685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-3160f804-702e-42e3-bb13-e021106d118b req-8b903935-299e-4257-83ec-27099713d38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:48.638750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.640116 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.640772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:48.641646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.642489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.643163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:48.647484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-3160f804-702e-42e3-bb13-e021106d118b req-8b903935-299e-4257-83ec-27099713d38a service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.648268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-3160f804-702e-42e3-bb13-e021106d118b req-8b903935-299e-4257-83ec-27099713d38a service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.649562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-3160f804-702e-42e3-bb13-e021106d118b req-8b903935-299e-4257-83ec-27099713d38a service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:48.674036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:34:48.678999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-3160f804-702e-42e3-bb13-e021106d118b req-8b903935-299e-4257-83ec-27099713d38a service nova] Creating event network-changed:8b771fe9-cb75-4a40-83f5-e824ba468b93 for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe on hv-cinder-80295 Aug 05 14:34:48.688305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-3160f804-702e-42e3-bb13-e021106d118b req-8b903935-299e-4257-83ec-27099713d38a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059908 Aug 05 14:34:48.688960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 394/786] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:34:48.825144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:48.826393 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:48.834104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.834583 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.835478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:48.836204 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:48.836694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:48.837127 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.069111 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-26ed8dfc-3acb-47e9-bb93-6b41205c4704 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 204 len: 0 microversion: 2.1 time: 0.442852 Aug 05 14:34:49.070915 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 393/787] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:34:48 2022] DELETE /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:34:49.084837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:49.100225 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:49.139909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.142298 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.152984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.152984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.153695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:49.154045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.154842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.163571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:49.165172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:49.172117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c8dc6109-b938-4ae4-9f15-8781db30a22b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.346452 Aug 05 14:34:49.190176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 395/788] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:48 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:49.269654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:49.272646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:49.280746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.281250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.281901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.282805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.283436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.283849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.347338 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-301fde25-02c0-45e5-9c33-6b799be79bbb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082637 Aug 05 14:34:49.361683 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 396/789] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:34:49 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:49.374024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:49.374551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:49.385942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.386471 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.389424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.390521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.392959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.397183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.467797 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:49.478457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cbe9a61a-122d-4ceb-8888-908570ea722b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.401690 Aug 05 14:34:49.486009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 394/790] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:49 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:49.486227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e9064ec9-6424-4ab6-9e6b-2493a4165c52 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8804fa37-1fe6-4d3d-af04-f6daeb1d6f98" status: 200 len: 194 microversion: 2.1 time: 0.117687 Aug 05 14:34:49.486344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:49.486344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:49.490147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 397/791] 10.222.0.26 () {58 vars in 1413 bytes} [Fri Aug 5 14:34:49 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8804fa37-1fe6-4d3d-af04-f6daeb1d6f98 => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:49.505861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.506452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.506983 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.511299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:49.512372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:49.512928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:49.770318 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:49.781470 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5307f9f4-870f-444b-98dc-501d8e439209 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.300585 Aug 05 14:34:49.782207 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 395/792] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:49 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:50.204438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:50.205354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:50.214355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:50.215174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:50.215767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:50.216589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:50.217124 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:50.217624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:50.409047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:50.418200 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:50.420400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:50.422020 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bc8339db-8412-4748-b17b-3ff6a55e18ef tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.224989 Aug 05 14:34:50.423157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 398/793] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:50 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:34:50.507527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:50.508076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:50.515023 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:50.515511 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:50.515947 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:50.516888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:50.517504 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:50.518084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:50.656061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:50.664019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ff263d86-95cd-4abe-a7f0-c132430d4ac4 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.160595 Aug 05 14:34:50.678422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 396/794] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:50 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:50.805798 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:50.806325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:50.812674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:50.813158 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:50.813602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:50.814277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:50.814910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:50.815337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:50.953810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:50.961671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9109f3f2-428f-400c-ad45-9e290510825a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.160182 Aug 05 14:34:50.962467 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 399/795] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:50 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:51.172359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-22bf99d0-5d87-4527-bf0c-bd2195e442cc req-593b9469-3de7-4a2a-b02f-eff7f665985e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "name": "network-vif-plugged", "status": "completed", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:51.177690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:51.184150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-22bf99d0-5d87-4527-bf0c-bd2195e442cc req-593b9469-3de7-4a2a-b02f-eff7f665985e service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.184704 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-22bf99d0-5d87-4527-bf0c-bd2195e442cc req-593b9469-3de7-4a2a-b02f-eff7f665985e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.185138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-22bf99d0-5d87-4527-bf0c-bd2195e442cc req-593b9469-3de7-4a2a-b02f-eff7f665985e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:51.198735 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-22bf99d0-5d87-4527-bf0c-bd2195e442cc req-593b9469-3de7-4a2a-b02f-eff7f665985e service nova] Creating event network-vif-plugged:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:34:51.204108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-22bf99d0-5d87-4527-bf0c-bd2195e442cc req-593b9469-3de7-4a2a-b02f-eff7f665985e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Aug 05 14:34:51.204773 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 397/796] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:34:51.446100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:51.446713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:51.453601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.454429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.455054 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:51.455981 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.456459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.456889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:51.687562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:51.688300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:51.695048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.695545 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.695980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:51.696911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.697546 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.698261 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:51.761944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:51.770548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:51.772497 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:51.773913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-255cbec2-4271-498d-a5b6-4c7b2c29a785 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.331818 Aug 05 14:34:51.788444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 400/797] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:51 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:51.862943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:51.871667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9d0ade45-9b71-44c0-90e6-80ebc7c8d637 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.189592 Aug 05 14:34:51.872259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 398/798] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:51 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:51.984846 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:51.985472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:51.992923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.993531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.994055 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:51.994901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:51.995371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:51.995834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:52.137153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:52.144703 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7adc1a80-b19d-491d-bf02-5e79d4026112 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.163905 Aug 05 14:34:52.145279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 401/799] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:51 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:52.439871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bb10d75-7770-4c33-b642-9ffd1a88ff70"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:34:52.443515 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:52.451229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:52.451726 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:52.452163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:52.452939 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:52.453445 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:52.454069 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:52.627749 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:52.647542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:52.799955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:52.817521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:52.817521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:52.817521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:52.817521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:52.817961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:52.817961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:52.817961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:52.817961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:52.868147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:52.951255 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:52.979441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:52.981810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:52.983273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ca87d7db-b56d-401c-b249-c35b7cb5c323 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.187301 Aug 05 14:34:52.984043 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 402/800] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:52 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:52.989147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:52.989975 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:53.002815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:53.003320 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:53.004021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:53.004983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:53.005442 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:53.005868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:53.167592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:53.177228 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bcf07f2c-28d0-4ff9-8409-312b14905efd tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.191608 Aug 05 14:34:53.185753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 403/801] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:52 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:53.185753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:53.185753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:53.190546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:53.191073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:53.191596 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:53.192446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:53.192992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:53.193495 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:53.358283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:53.366699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ac9782a7-f837-45b9-8bdc-a7f37ea7fac9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.187702 Aug 05 14:34:53.367392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 404/802] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:53 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:54.007720 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:54.008439 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:54.018396 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:54.027277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:54.027277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:54.027277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:54.027277 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:54.027789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:54.174049 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:54.182125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:54.184702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:54.185884 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-67881feb-8122-4b11-8fa9-a9b9fdc6f0a9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.182245 Aug 05 14:34:54.186435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 405/803] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:54 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:54.200789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:54.204334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:54.211384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:54.211932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:54.212374 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:54.213110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:54.213590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:54.214023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:54.351928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:54.361468 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6b8f1a24-769d-4903-ae3e-baedfcfa6a43 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.166577 Aug 05 14:34:54.362047 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 406/804] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:54 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:54.389968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:54.390580 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:54.396571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:54.397065 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:54.397503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:54.398208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:54.398677 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:54.399093 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:54.550176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:54.557958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a25f98e7-bc34-4066-a8d0-269a59f5d08d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.172508 Aug 05 14:34:54.558844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 407/805] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:54 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:55.210243 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:55.210951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:55.217423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:55.217911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:55.218350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:55.219318 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:55.219770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:55.220191 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:55.387869 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:55.397209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:55.399091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:55.400235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0f707be3-796b-4896-b7b6-08f05753d50d tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.194129 Aug 05 14:34:55.400833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 408/806] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:55 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:55.421244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:55.421782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:55.427866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:55.428364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:55.428827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:55.429531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:55.429986 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:55.430431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:55.435626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:34:55.584823 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:55.593251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-30d254a3-d5c5-4584-934b-cb09c82390d6 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.176669 Aug 05 14:34:55.595061 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 409/807] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:55 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:55.600656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:55.601579 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:55.609862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:55.610412 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:55.610880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:55.611598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:55.612087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:55.612741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:55.789693 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:55.797944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-882ca3ad-bd42-4298-9923-d8b5464d1bb7 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.201493 Aug 05 14:34:55.798509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 410/808] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:55 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:56.424228 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:56.424967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:56.431179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:56.431661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:56.432231 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:56.433649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:56.433649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:56.433966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:56.580791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:56.590236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:56.591795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:56.593024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f3b8ffd6-1f52-443b-999a-ddb6da720429 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.172694 Aug 05 14:34:56.593861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 411/809] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:56 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:56.616296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:56.617035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:56.623535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:56.624116 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:56.624787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:56.625835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:56.626293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:56.626762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:56.769856 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:56.778993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-da1fcdcb-2ec2-4277-b3b2-c1d8f80bd2fc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.166718 Aug 05 14:34:56.779925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 412/810] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:56 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:34:56.819509 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:56.820132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:56.827655 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:56.828152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:56.828629 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:56.829343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:56.829803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:56.830233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:56.974694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:56.983120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b07c69af-6d16-4a42-8f31-705c2f38610b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.167552 Aug 05 14:34:56.983700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 413/811] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:56 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:57.617020 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:57.617729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:57.625372 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:57.625928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:57.626369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:57.627062 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:57.627521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:57.627945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:57.769475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:57.778269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:57.779782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:57.781002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-30941d3c-4745-419c-9f38-1bc87ab88e0b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.167975 Aug 05 14:34:57.786352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 414/812] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:57 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:57.801896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:57.802508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:57.809672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:57.810246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:57.810770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:57.811666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:57.812209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:57.812662 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:57.967594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:57.976269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-75525646-0111-4e87-9654-819aade2e65e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.178078 Aug 05 14:34:57.976929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 415/813] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:57 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:58.006411 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:58.010644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:58.013325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:58.013814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:58.014272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:58.014973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:58.015430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:58.015855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:58.147293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:58.156185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7c809ead-ce56-49c6-9d6f-57cc898f5b38 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.154739 Aug 05 14:34:58.156843 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 416/814] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:58 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:58.804202 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:58.804925 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:58.811159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:58.811642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:58.812078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:58.812797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:58.813247 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:58.813667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:58.944374 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:58.952915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:58.954484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:58.955642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c50c7124-ea3c-4a73-8bb9-c44b73f07196 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.155398 Aug 05 14:34:58.956229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 417/815] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:58 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:34:58.999827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:59.000506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:59.006360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:59.006844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:59.007282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:59.007969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:59.008438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:59.008875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:59.144057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:59.152249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bb88048a-9ae5-4107-8cac-af81c79cf22e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.156249 Aug 05 14:34:59.152870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 418/816] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:58 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:59.176491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:59.177098 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:59.182713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:59.183198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:59.183637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:59.184325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:59.184809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:59.185236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:59.316004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:34:59.324059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7e9d49fc-088d-494a-84d8-8d34d2ad1d02 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.151041 Aug 05 14:34:59.324712 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 419/817] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:34:59 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:34:59.981076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:34:59.981737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:34:59.988097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:59.988614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:59.989046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:34:59.989725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:34:59.990180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:34:59.990597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:00.122795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:00.130737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:00.132276 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:00.133521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9a6d4d12-f5f0-4084-97fe-e579c8366e70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.157397 Aug 05 14:35:00.134075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 420/818] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:34:59 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:35:00.173262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:00.173896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:00.179667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:00.180144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:00.180621 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:00.181301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:00.181754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:00.182172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:00.310766 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:00.318222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b47184dd-ee0a-407d-934e-db8cf86f729e tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.148717 Aug 05 14:35:00.318796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 421/819] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:00 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:00.344989 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:00.345533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:00.351247 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:00.351737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:00.352183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:00.352908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:00.353396 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:00.353827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:00.504080 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:00.511844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d0dba33b-0362-44d8-8f8f-9e64bcede4ed tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.170784 Aug 05 14:35:00.512445 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 422/820] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:00 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:35:01.158101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:01.158769 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:01.165155 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:01.165644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:01.166077 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:01.166840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:01.167418 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:01.167929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:01.298990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:01.306820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:01.308469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:01.309626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e972523d-5180-46ae-9497-f2f0a3f1d5d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.155454 Aug 05 14:35:01.310191 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 423/821] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:35:01 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:35:01.339525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:01.340136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:01.346223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:01.346707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:01.347144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:01.347840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:01.348303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:01.348752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:01.481525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:01.489366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8e4e0e2a-aa89-4676-a475-740863380d37 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.154263 Aug 05 14:35:01.489950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 424/822] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:01 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:35:01.535488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:01.536186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:01.542231 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:01.542911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:01.543352 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:01.544059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:01.544670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:01.545099 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:01.678532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:01.681928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:01.686438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e48d21e8-a14f-4e3f-be24-50b491279cda tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.155121 Aug 05 14:35:01.687013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 425/823] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:01 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:35:02.334861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:02.340091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:02.347723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.348339 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.348927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.349851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.350407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.350936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.447866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=5 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:02.493899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d2207bae-22de-4c43-b958-ba18e62280cb tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "POST /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.059083 Aug 05 14:35:02.495492 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 399/824] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:34:52 2022] POST /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments => generated 194 bytes in 10062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:02.527460 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:02.528215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:02.542889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.543649 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.544137 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.545145 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.546118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.546743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.717666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:02.726175 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:02.727874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:02.729667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4ce64724-e5c1-47b1-a9f7-4c4ce7cc8c7f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.399699 Aug 05 14:35:02.730229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 426/825] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:35:02 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:35:02.735149 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-89d9fe1f-b863-41e1-b98f-848b050e752f req-527d0cb8-6f1b-436d-8bf2-5792b16ce01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:02.749762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-89d9fe1f-b863-41e1-b98f-848b050e752f req-527d0cb8-6f1b-436d-8bf2-5792b16ce01c service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.749762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-89d9fe1f-b863-41e1-b98f-848b050e752f req-527d0cb8-6f1b-436d-8bf2-5792b16ce01c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.749762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-89d9fe1f-b863-41e1-b98f-848b050e752f req-527d0cb8-6f1b-436d-8bf2-5792b16ce01c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.758222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-89d9fe1f-b863-41e1-b98f-848b050e752f req-527d0cb8-6f1b-436d-8bf2-5792b16ce01c service nova] Creating event network-changed:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:35:02.763331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-89d9fe1f-b863-41e1-b98f-848b050e752f req-527d0cb8-6f1b-436d-8bf2-5792b16ce01c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 Aug 05 14:35:02.763927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 427/826] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:02.768309 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:02.769142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:02.769844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:02.776130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-547e7a13-af6f-4e97-8db2-260714a87b61 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1567 microversion: 2.1 time: 0.262587 Aug 05 14:35:02.776326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.776697 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.777142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.777393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 400/827] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:02 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:02.777980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.778448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.778879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.975758 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-afb38bb1-5625-4a5f-b97b-761ea11b6068 req-8011d8e8-a92d-4ad6-9485-9d7007ba0ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a4095-fa11-4d30-ab95-ee35d9d69dbe", "name": "network-vif-deleted", "tag": "8b771fe9-cb75-4a40-83f5-e824ba468b93"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:02.986564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-afb38bb1-5625-4a5f-b97b-761ea11b6068 req-8011d8e8-a92d-4ad6-9485-9d7007ba0ccc service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:02.987038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-afb38bb1-5625-4a5f-b97b-761ea11b6068 req-8011d8e8-a92d-4ad6-9485-9d7007ba0ccc service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:02.987719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-afb38bb1-5625-4a5f-b97b-761ea11b6068 req-8011d8e8-a92d-4ad6-9485-9d7007ba0ccc service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:02.999129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-afb38bb1-5625-4a5f-b97b-761ea11b6068 req-8011d8e8-a92d-4ad6-9485-9d7007ba0ccc service nova] Creating event network-vif-deleted:8b771fe9-cb75-4a40-83f5-e824ba468b93 for instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe on hv-cinder-80295 Aug 05 14:35:03.004185 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-afb38bb1-5625-4a5f-b97b-761ea11b6068 req-8011d8e8-a92d-4ad6-9485-9d7007ba0ccc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031994 Aug 05 14:35:03.005009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 401/828] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:03.014483 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:03.021978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8c4b8e3a-fc04-4f8d-a645-6463fae7ff34 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.256857 Aug 05 14:35:03.022541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 428/829] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:02 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:03.754440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:03.755136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:03.762450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:03.763191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:03.763513 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:03.764217 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:03.764711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:03.765142 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:03.797826 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:03.798366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:03.804763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:03.805244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:03.805676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:03.806366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:03.806818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:03.807240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:03.887451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:03.895144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b8bf758b-8cfd-4567-a8e5-60f1b257021b tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1217 microversion: 2.1 time: 0.101442 Aug 05 14:35:03.895724 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 429/830] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:03 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:35:03.916876 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:03.925165 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:03.926616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:03.927774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e4782744-c7fe-4c00-a4e3-9afbd2a402d3 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.177876 Aug 05 14:35:03.928338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 402/831] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:35:03 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:35:04.043160 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:04.043815 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:04.050451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.050876 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.051316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.052008 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.052495 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.052953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.184651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:04.192171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d31229a8-8ce5-4850-b094-bd9c2dc219b1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.152891 Aug 05 14:35:04.192792 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 430/832] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:04 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:04.915178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:04.915776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:04.922694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.923170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.923597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.924325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.924794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.925210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.952638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:04.953327 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:04.959924 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.960518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.961036 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.961818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.962286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.962717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.966230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:04.966715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:04.967147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:04.967586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lazy-loading 'fault' on Instance uuid de6a4095-fa11-4d30-ab95-ee35d9d69dbe {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:05.010236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:05.019608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2109ce4c-3d78-49be-ac0b-52c41bcb1722 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1222 microversion: 2.1 time: 0.108341 Aug 05 14:35:05.020358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 403/833] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:04 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:05.106932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:05.114993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:05.118502 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:05.118502 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4d408741-540d-46de-92d2-01d5559a8975 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.170570 Aug 05 14:35:05.118502 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 431/834] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:35:04 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:35:05.212847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:05.213551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:05.220834 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:05.221311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:05.221743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:05.222424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:05.222873 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:05.223295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:05.239320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:05.357485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:05.364830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-260e1e83-5b86-4378-abb4-3244b4f56a44 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.155917 Aug 05 14:35:05.365404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 404/835] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:05 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:06.042452 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:06.043112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:06.049487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.049967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.050399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.051081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.051540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.051971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.082484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.082959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.083392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.083828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lazy-loading 'fault' on Instance uuid de6a4095-fa11-4d30-ab95-ee35d9d69dbe {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:06.123118 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:06.130389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-af2f71ea-0d4d-487c-8e2c-2f939f7c9df5 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1222 microversion: 2.1 time: 0.091964 Aug 05 14:35:06.130956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 432/836] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:06 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:06.142666 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:06.143269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:06.149891 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.150365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.150947 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.151624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.152104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.152831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.279363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:06.287119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:06.288642 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:06.289780 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9c75af64-19dd-4c02-bd11-9e83526f9228 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1730 microversion: 2.20 time: 0.151326 Aug 05 14:35:06.292246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 405/837] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:35:06 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:35:06.385100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:06.385715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:06.392029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.392550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.392988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.393670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:06.394125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:06.394552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:06.525181 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:06.532725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9842671e-058a-4e9d-a986-5e306ead9ac5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.151410 Aug 05 14:35:06.533299 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 433/838] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:06 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:07.151087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:07.151673 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:07.165443 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.165942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.166383 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.167084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.167535 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.168624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.201847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.202319 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.202743 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.203177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lazy-loading 'fault' on Instance uuid de6a4095-fa11-4d30-ab95-ee35d9d69dbe {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:07.243956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:07.251506 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5811f460-893c-4720-9560-657a69ed8476 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1222 microversion: 2.1 time: 0.104299 Aug 05 14:35:07.252071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 406/839] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:07 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:07.312264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:07.312966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:07.319388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.319866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.320308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.321149 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.321607 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.322032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.448624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:07.457208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:07.458710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:07.459861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-42991a05-88d0-43a7-80d4-8f05e6093e31 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1717 microversion: 2.20 time: 0.151727 Aug 05 14:35:07.460431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 434/840] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:35:07 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:35:07.554579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:07.555356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:07.562098 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.562630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.563012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.563692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:07.564664 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:07.565089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:07.700537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:07.707988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-04a11900-04a2-4f4d-ace6-fb0352782a84 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.157943 Aug 05 14:35:07.708584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 407/841] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:07 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:08.272315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:08.272962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:08.279701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:08.280188 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:08.281673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:08.281673 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:08.281868 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:08.282278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:08.313608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:08.314254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:08.314527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:08.314973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lazy-loading 'fault' on Instance uuid de6a4095-fa11-4d30-ab95-ee35d9d69dbe {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:08.358316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b2cb4c04f6495bbb5ff171df953ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717d08ca01041088bd4b95f00d7b5ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:08.366506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9c33dae7-9098-479e-aa29-184c51f336cc tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 200 len: 1222 microversion: 2.1 time: 0.098062 Aug 05 14:35:08.367083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 435/842] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:08 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:08.729441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:08.730059 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:08.736494 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:08.741703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:08.741703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:08.741703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:08.741703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:08.742030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:08.868149 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:08.875878 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c5afbcac-4619-4fcc-a2b2-7c70fc2c7ae8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.150411 Aug 05 14:35:08.876482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 408/843] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:08 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:08.996094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:08.999312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:09.006312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.007226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.007949 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.008684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.009142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.009569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.041442 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7de135a8-a0b1-4a40-bf32-c9c3e87530db tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049444 Aug 05 14:35:09.041994 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 436/844] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:35:08 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:09.180197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:09.180827 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:09.186909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.187387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.187814 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.188527 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.188978 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.189397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.218570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bee61233-f040-4a03-af34-100b3b65d7ec tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8804fa37-1fe6-4d3d-af04-f6daeb1d6f98" status: 200 len: 194 microversion: 2.1 time: 0.042319 Aug 05 14:35:09.219428 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 409/845] 10.222.0.26 () {58 vars in 1413 bytes} [Fri Aug 5 14:35:09 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8804fa37-1fe6-4d3d-af04-f6daeb1d6f98 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:09.229666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:09.230165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:09.236908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.237404 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.237845 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.238540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.238999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.239430 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.321909 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lazy-loading 'services' on Instance uuid 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:09.387262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:09.388027 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [instance: de6a4095-fa11-4d30-ab95-ee35d9d69dbe] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:09.394470 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.394954 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.395389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.396149 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.396706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.397128 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.411461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] HTTP exception thrown: Instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe could not be found. Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Request method failure captured: Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe HTTP/1.1 Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sjut43Dl809qE5C8h8qS7YuGX1aYDkaABd1yKhdpvGt_Fz9rrg7vSKnh6Yrs7dd7ZKzc1ZioiBcGdFHkqVjtx8fRd3EPAJEj80FodouHRy3jirajKFDMWzsbW-lb5-XKgXqwUVgHFoVR-C6vajPgxHBwNUSVhmAuC3CbIgn3FqiPqY Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 4717d08ca01041088bd4b95f00d7b5ef Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-TestShelveInstance-284767393 Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:35:09.413158 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4717d08ca01041088bd4b95f00d7b5ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4717d08ca01041088bd4b95f00d7b5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4717d08ca01041088bd4b95f00d7b5ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4717d08ca01041088bd4b95f00d7b5ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-TestShelveInstance-284767393 Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 4717d08ca01041088bd4b95f00d7b5ef Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-TestShelveInstance-284767393 Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-TestShelveInstance-284767393-project Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 33b2cb4c04f6495bbb5ff171df953ef0 Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-TestShelveInstance-284767393-project Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe could not be found. Aug 05 14:35:09.414968 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'de6a4095-fa11-4d30-ab95-ee35d9d69dbe'} Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe could not be found. Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:35:09.415831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe could not be found. Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe could not be found. Aug 05 14:35:09.417370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:09.418957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Returning 404 to user: Instance de6a4095-fa11-4d30-ab95-ee35d9d69dbe could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:35:09.418957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-59b15946-a3f8-4c6c-894b-f29f04341667 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe" status: 404 len: 111 microversion: 2.1 time: 0.031322 Aug 05 14:35:09.418957 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 410/846] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:09 2022] GET /compute/v2.1/servers/de6a4095-fa11-4d30-ab95-ee35d9d69dbe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:35:09.548677 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-62758948-86fc-4f89-8525-3e570fd0577f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8804fa37-1fe6-4d3d-af04-f6daeb1d6f98" status: 202 len: 0 microversion: 2.1 time: 0.322752 Aug 05 14:35:09.551522 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 437/847] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:35:09 2022] DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8804fa37-1fe6-4d3d-af04-f6daeb1d6f98 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:35:09.678887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0411a61f-8438-4b69-9d0b-bf9d890cf970 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] Calling method '.version_select at 0x7fa75d8fcca0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:09.684556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0411a61f-8438-4b69-9d0b-bf9d890cf970 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [c438e709-1cd4-4e87-ab03-8fa6a00f97c6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 14:35:09.897816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:09.899272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:09.906597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.907086 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.907521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:09.908225 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:09.908713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:09.909138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:10.046042 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:10.053630 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-79a5bf04-4ff9-4f67-bc9f-811f0d4b60f1 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.160212 Aug 05 14:35:10.061830 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 438/848] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:09 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:35:10.693202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [None req-0411a61f-8438-4b69-9d0b-bf9d890cf970 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] [c438e709-1cd4-4e87-ab03-8fa6a00f97c6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 44530. Aug 05 14:35:10.765903 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0411a61f-8438-4b69-9d0b-bf9d890cf970 tempest-TestShelveInstance-284767393 tempest-TestShelveInstance-284767393-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-29136839" status: 202 len: 0 microversion: 2.1 time: 1.090769 Aug 05 14:35:10.766478 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 411/849] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-29136839 => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:35:11.075150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:11.075759 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:11.083926 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.084434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.085469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.086340 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.086963 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.087917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.286983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:11.296435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-32c45939-2834-4f46-86b2-fe5b738dc833 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.224920 Aug 05 14:35:11.297230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 439/850] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:11 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:11.371030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-4c6af019-8f1c-47f4-a3a9-d3d7a964e51b req-23077b33-569b-4be7-93ab-dea4a07a49dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "name": "network-vif-plugged", "status": "completed", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:11.381846 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-4c6af019-8f1c-47f4-a3a9-d3d7a964e51b req-23077b33-569b-4be7-93ab-dea4a07a49dd service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.382431 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-4c6af019-8f1c-47f4-a3a9-d3d7a964e51b req-23077b33-569b-4be7-93ab-dea4a07a49dd service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.382871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-4c6af019-8f1c-47f4-a3a9-d3d7a964e51b req-23077b33-569b-4be7-93ab-dea4a07a49dd service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.393285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-4c6af019-8f1c-47f4-a3a9-d3d7a964e51b req-23077b33-569b-4be7-93ab-dea4a07a49dd service nova] Creating event network-vif-plugged:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:35:11.398210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-4c6af019-8f1c-47f4-a3a9-d3d7a964e51b req-23077b33-569b-4be7-93ab-dea4a07a49dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031716 Aug 05 14:35:11.398809 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 412/851] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:11.736319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:11.741849 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:11.742743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.743231 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.743672 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.744368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.744880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.745292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.775995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d5d6c2b4-1f07-43ac-a44c-3850321ed932 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8bb10d75-7770-4c33-b642-9ffd1a88ff70" status: 200 len: 194 microversion: 2.1 time: 0.044215 Aug 05 14:35:11.776624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 440/852] 10.222.0.26 () {58 vars in 1413 bytes} [Fri Aug 5 14:35:11 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8bb10d75-7770-4c33-b642-9ffd1a88ff70 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:11.788390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:11.793528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:11.795682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.796329 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.796806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.797510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:11.797990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:11.798389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:11.884312 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lazy-loading 'services' on Instance uuid 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:12.114518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6332442f-7d13-457e-a5dd-50122ffbcbdc tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8bb10d75-7770-4c33-b642-9ffd1a88ff70" status: 202 len: 0 microversion: 2.1 time: 0.330631 Aug 05 14:35:12.115384 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 413/853] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:35:11 2022] DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments/8bb10d75-7770-4c33-b642-9ffd1a88ff70 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:35:12.318773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:12.319392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:12.332661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:12.332661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:12.332661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:12.332661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:12.333173 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:12.333173 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:12.474996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:12.478917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:12.484835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ae56cf89-a6db-4029-a7fe-cb27b0cc7544 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1358 microversion: 2.1 time: 0.168882 Aug 05 14:35:12.485440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 441/854] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:12 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:13.506808 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:13.507528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:13.519179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:13.519179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:13.519179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:13.519179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:13.519721 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:13.519721 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:13.753465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:13.761951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-116818a3-fcf5-45b3-a92a-04fafbe7ee68 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1547 microversion: 2.1 time: 0.259733 Aug 05 14:35:13.762626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 414/855] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:13 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1547 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:13.790471 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:13.791015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:13.801016 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:13.801501 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:13.801933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:13.802625 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:13.803348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:13.803654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:14.014090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:14.023631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5b377dde-8d53-4853-9572-fb1adb2ed2fc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1547 microversion: 2.1 time: 0.241684 Aug 05 14:35:14.024309 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 442/856] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:13 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:14.045177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:14.050584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:14.051639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Searching by: {'deleted': False, 'project_id': 'ca094dd6e4d64383b75640f040744140'} {{(pid=118052) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 14:35:14.058349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:14.058920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:14.059416 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:14.060204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:14.061009 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:14.061628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:14.162792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.multi_cell_list [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 14:35:14.260544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4dbc8ddc-e3a8-4a73-b60a-83dd97a024d8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219191 Aug 05 14:35:14.261144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 415/857] 10.222.0.26 () {58 vars in 1125 bytes} [Fri Aug 5 14:35:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:14.274851 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:14.275724 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:14.283655 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:14.284388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:14.285035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:14.285741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:14.286380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:14.286809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:14.486125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:14.493812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-28a797e2-5397-4af8-8965-d7a8f9969cf8 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1547 microversion: 2.1 time: 0.224542 Aug 05 14:35:14.494385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 443/858] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:14 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1547 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:15.430160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:15.432260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:15.438686 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:15.439170 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:15.439601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:15.440294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:15.440774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:15.441205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:15.471250 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6d814a26-0626-4645-800f-dc4afa7d81b3 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044970 Aug 05 14:35:15.471816 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 416/859] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:35:15 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:35:15.585980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:15.588820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:15.595684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:15.596186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:15.596631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:15.597330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:15.597783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:15.598204 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:15.627568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-54da5553-505a-4f6e-b694-62b489d78409 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045683 Aug 05 14:35:15.628141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 444/860] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:35:15 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:35:15.688613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:15.689117 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:15.694930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:15.695421 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:15.695855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:15.702591 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:15.702591 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:15.702591 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:15.725408 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:35:16.218284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9bc21532-419f-43a7-8e21-39f24aaf6353 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 204 len: 0 microversion: 2.1 time: 0.520481 Aug 05 14:35:16.218284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 417/861] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:35:15 2022] DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:35:16.219394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:16.220009 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:16.226300 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:16.226793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:16.227235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:16.227936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:16.228395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:16.228864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:16.418388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35557781-9b44-4c7a-99b7-580a1bed6afb"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:16.420745 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:16.427722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:16.428207 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:16.428673 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:16.429371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:16.429832 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:16.430310 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:16.540922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:16.550773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-92e93ff1-c8e1-41bb-8be4-6c49f17c120f tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1674 microversion: 2.1 time: 0.335751 Aug 05 14:35:16.551732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 445/862] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:16 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:17.572838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:17.573437 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:17.580666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:17.581154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:17.581594 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:17.582290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:17.582745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:17.583167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:17.720952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:17.728490 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-96dbc9e6-d0e5-4034-8d26-4a4e6b7e2c1a tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1674 microversion: 2.1 time: 0.159431 Aug 05 14:35:17.738938 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 446/863] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:17 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:18.679295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b72caefe-9acf-4d76-8f51-b74aded7f046 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.265054 Aug 05 14:35:18.682874 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 418/864] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:35:16 2022] POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments => generated 194 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:35:18.757670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:18.760032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:18.770044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:18.770545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:18.771184 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:18.771904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:18.772355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:18.772877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:18.915746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:18.924364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-cfd5d682-a199-4701-8e17-86d9e33dc3af tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1674 microversion: 2.1 time: 0.176551 Aug 05 14:35:18.925060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 447/865] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:18 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:19.506556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-809d1909-f9d2-4521-b864-c7b77a246f98 req-7394bc4b-9e22-470d-b9b3-bb6e1e6f9624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfcb42f-4569-4f50-a12d-ee7bf900ada5", "name": "network-vif-deleted", "tag": "38712c42-840e-4978-b958-8bd8cc5562cc"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:19.518626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-809d1909-f9d2-4521-b864-c7b77a246f98 req-7394bc4b-9e22-470d-b9b3-bb6e1e6f9624 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:19.520690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-809d1909-f9d2-4521-b864-c7b77a246f98 req-7394bc4b-9e22-470d-b9b3-bb6e1e6f9624 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:19.520690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-809d1909-f9d2-4521-b864-c7b77a246f98 req-7394bc4b-9e22-470d-b9b3-bb6e1e6f9624 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:19.525204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:19.533106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-809d1909-f9d2-4521-b864-c7b77a246f98 req-7394bc4b-9e22-470d-b9b3-bb6e1e6f9624 service nova] Creating event network-vif-deleted:38712c42-840e-4978-b958-8bd8cc5562cc for instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 on hv-cinder-80295 Aug 05 14:35:19.538320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-809d1909-f9d2-4521-b864-c7b77a246f98 req-7394bc4b-9e22-470d-b9b3-bb6e1e6f9624 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036254 Aug 05 14:35:19.539512 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 419/866] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:19.954018 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:19.956005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:19.965157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:19.966045 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:19.966639 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:19.967506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:19.969244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:19.975359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:20.006019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:20.006763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:20.007201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:20.007643 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lazy-loading 'fault' on Instance uuid 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:35:20.051220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99dc94fff06f42c39f3750484f6d8e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b15967673f14cf9a208a6143a4e87cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:20.058796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bd7aa12d-9fde-4821-a825-e78cc7f2dfd2 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 200 len: 1327 microversion: 2.1 time: 0.114807 Aug 05 14:35:20.059670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 448/867] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:19 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:21.087806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:21.088428 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:21.095400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:21.099106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:21.099106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:21.099106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:21.099106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:21.099466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:21.110841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] HTTP exception thrown: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Request method failure captured: Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 HTTP/1.1 Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShVdzmCVe7BTn24jwUZMBy1uUx8-eom23N53JXAzgr683jiOUyM60O_44xB4GH90y5dEMDluZQHNS4VHLPwSj70bLSFjZNJTj2DXranf1a3ri5tmwIFP5gjZ5Tf8YllyLeqKvztrZ8hpWw3MuQt2FRHw9Hjcquj3agVIugFvzUYklY Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:35:21.112436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b15967673f14cf9a208a6143a4e87cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 99dc94fff06f42c39f3750484f6d8e9d Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:21.113992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '1bfcb42f-4569-4f50-a12d-ee7bf900ada5'} Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:35:21.114863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:21.116289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:21.117691 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Returning 404 to user: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:35:21.117691 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3eb0b294-6a62-4028-a9e8-8bea87b1382b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 404 len: 111 microversion: 2.1 time: 0.031160 Aug 05 14:35:21.117691 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 420/868] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:21 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:35:21.122799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9b16562f-f08e-4e96-ba75-cb56d45a8498 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '.version_select at 0x7fa75d330280>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:21.130279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=100 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:21.229305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9b16562f-f08e-4e96-ba75-cb56d45a8498 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178551274" status: 202 len: 0 microversion: 2.1 time: 0.110327 Aug 05 14:35:21.229922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 449/869] 10.222.0.26 () {58 vars in 1221 bytes} [Fri Aug 5 14:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178551274 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:35:25.614340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:25.614951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:25.617461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:25.622570 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:25.623055 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:25.623491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:25.624885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:25.625357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:25.625785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:25.639332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] HTTP exception thrown: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Request method failure captured: Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 HTTP/1.1 Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShVdzmCVe7BTn24jwUZMBy1uUx8-eom23N53JXAzgr683jiOUyM60O_44xB4GH90y5dEMDluZQHNS4VHLPwSj70bLSFjZNJTj2DXranf1a3ri5tmwIFP5gjZ5Tf8YllyLeqKvztrZ8hpWw3MuQt2FRHw9Hjcquj3agVIugFvzUYklY Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:35:25.641471 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b15967673f14cf9a208a6143a4e87cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 99dc94fff06f42c39f3750484f6d8e9d Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.643118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '1bfcb42f-4569-4f50-a12d-ee7bf900ada5'} Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:35:25.644131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.645730 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.647359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Returning 404 to user: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:35:25.647359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-85c67194-bcf2-4ae4-933c-375bff4f7efd tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 404 len: 111 microversion: 2.1 time: 0.032750 Aug 05 14:35:25.647359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 421/870] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:35:25 2022] DELETE /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:35:25.651948 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:25.652670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 1bfcb42f-4569-4f50-a12d-ee7bf900ada5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:25.659902 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:25.660382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:25.660844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:25.661535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:25.661993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:25.662418 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:25.677638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] HTTP exception thrown: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Request method failure captured: Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 HTTP/1.1 Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShVdzmCVe7BTn24jwUZMBy1uUx8-eom23N53JXAzgr683jiOUyM60O_44xB4GH90y5dEMDluZQHNS4VHLPwSj70bLSFjZNJTj2DXranf1a3ri5tmwIFP5gjZ5Tf8YllyLeqKvztrZ8hpWw3MuQt2FRHw9Hjcquj3agVIugFvzUYklY Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:35:25.679332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b15967673f14cf9a208a6143a4e87cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 99dc94fff06f42c39f3750484f6d8e9d Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.686976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '1bfcb42f-4569-4f50-a12d-ee7bf900ada5'} Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:35:25.688107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. Aug 05 14:35:25.689587 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:25.691315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Returning 404 to user: Instance 1bfcb42f-4569-4f50-a12d-ee7bf900ada5 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:35:25.691315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fb0a4e02-acc7-4a24-ac8c-3a78636696aa tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5" status: 404 len: 111 microversion: 2.1 time: 0.033342 Aug 05 14:35:25.691315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 450/871] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:25 2022] GET /compute/v2.1/servers/1bfcb42f-4569-4f50-a12d-ee7bf900ada5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:35:26.320514 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:26.321126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:26.328718 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:26.329342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:26.329626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:26.330367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:26.330819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:26.331242 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:26.462783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:26.470955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-89f11c23-4355-425c-b7f0-9a4a9be7faba tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1593 microversion: 2.1 time: 0.154976 Aug 05 14:35:26.471506 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 422/872] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:26 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:26.971384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:26.971916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:26.978455 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:26.978939 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:26.979369 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:26.980059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:26.980591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:26.984676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:26.995784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] HTTP exception thrown: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Request method failure captured: Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 HTTP/1.1 Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShVdzmCVe7BTn24jwUZMBy1uUx8-eom23N53JXAzgr683jiOUyM60O_44xB4GH90y5dEMDluZQHNS4VHLPwSj70bLSFjZNJTj2DXranf1a3ri5tmwIFP5gjZ5Tf8YllyLeqKvztrZ8hpWw3MuQt2FRHw9Hjcquj3agVIugFvzUYklY Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:35:26.997424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b15967673f14cf9a208a6143a4e87cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 99dc94fff06f42c39f3750484f6d8e9d Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:26.998901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '0a17e392-41cb-4261-94a6-5f144eefe190'} Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:35:26.999656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.001371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.002898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Returning 404 to user: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:35:27.002898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1d2156e6-91a2-4efa-8de5-9429df51dc8b tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 404 len: 111 microversion: 2.1 time: 0.032579 Aug 05 14:35:27.002898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 451/873] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:35:26 2022] DELETE /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:35:27.008654 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:27.013472 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] [instance: 0a17e392-41cb-4261-94a6-5f144eefe190] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:27.016378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:27.016906 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:27.017344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:27.018057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:27.018513 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:27.018941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:27.034489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] HTTP exception thrown: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Request method failure captured: Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 HTTP/1.1 Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShVdzmCVe7BTn24jwUZMBy1uUx8-eom23N53JXAzgr683jiOUyM60O_44xB4GH90y5dEMDluZQHNS4VHLPwSj70bLSFjZNJTj2DXranf1a3ri5tmwIFP5gjZ5Tf8YllyLeqKvztrZ8hpWw3MuQt2FRHw9Hjcquj3agVIugFvzUYklY Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:35:27.036037 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b15967673f14cf9a208a6143a4e87cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b15967673f14cf9a208a6143a4e87cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 0b15967673f14cf9a208a6143a4e87cc Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-121325203 Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 99dc94fff06f42c39f3750484f6d8e9d Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeTestJSON-121325203-project Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.037424 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '0a17e392-41cb-4261-94a6-5f144eefe190'} Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:35:27.038273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. Aug 05 14:35:27.039800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:35:27.049305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] Returning 404 to user: Instance 0a17e392-41cb-4261-94a6-5f144eefe190 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:35:27.049305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-702d7887-437d-4d9b-8cb0-fd4f7e1efcd6 tempest-AttachVolumeTestJSON-121325203 tempest-AttachVolumeTestJSON-121325203-project] 10.222.0.26 "GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190" status: 404 len: 111 microversion: 2.1 time: 0.032828 Aug 05 14:35:27.049305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 423/874] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:27 2022] GET /compute/v2.1/servers/0a17e392-41cb-4261-94a6-5f144eefe190 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:35:28.928832 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-10f5f299-96c1-442e-af68-834de95fc860 req-1433cb68-51a8-4a09-b623-5b03201883ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:28.948057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-10f5f299-96c1-442e-af68-834de95fc860 req-1433cb68-51a8-4a09-b623-5b03201883ef service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:28.948988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-10f5f299-96c1-442e-af68-834de95fc860 req-1433cb68-51a8-4a09-b623-5b03201883ef service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:28.949627 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-10f5f299-96c1-442e-af68-834de95fc860 req-1433cb68-51a8-4a09-b623-5b03201883ef service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:28.964164 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-10f5f299-96c1-442e-af68-834de95fc860 req-1433cb68-51a8-4a09-b623-5b03201883ef service nova] Creating event network-changed:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:35:28.975126 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-10f5f299-96c1-442e-af68-834de95fc860 req-1433cb68-51a8-4a09-b623-5b03201883ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049313 Aug 05 14:35:28.976669 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 452/875] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:31.838857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-970375670"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:31.839297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:31.846057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:31.846583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:31.846970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:31.847657 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:31.848104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:31.848549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:31.987769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.network.security_group_api [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Adding security group de7f5dcc-a4a1-41fa-aa08-5bc79a5f5c88 to port 2e954f61-c429-464f-983d-14b39304d5d6 Aug 05 14:35:32.430488 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-40d0f97f-95c1-45a8-b2f8-587d2624a5ef tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/action" status: 202 len: 0 microversion: 2.1 time: 0.595782 Aug 05 14:35:32.431437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 424/876] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:35:31 2022] POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:35:32.440511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:32.441214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:32.446361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-0af428bd-122b-4903-ad10-d54f4859be11 req-209066af-133e-48d7-b2a2-bf2e5a9812f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:32.464805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:32.465605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:32.466218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:32.466346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-0af428bd-122b-4903-ad10-d54f4859be11 req-209066af-133e-48d7-b2a2-bf2e5a9812f7 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:32.467114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-0af428bd-122b-4903-ad10-d54f4859be11 req-209066af-133e-48d7-b2a2-bf2e5a9812f7 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:32.467342 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:32.468930 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:32.469321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-0af428bd-122b-4903-ad10-d54f4859be11 req-209066af-133e-48d7-b2a2-bf2e5a9812f7 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:32.469842 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:32.491667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-0af428bd-122b-4903-ad10-d54f4859be11 req-209066af-133e-48d7-b2a2-bf2e5a9812f7 service nova] Creating event network-changed:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:35:32.502549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-0af428bd-122b-4903-ad10-d54f4859be11 req-209066af-133e-48d7-b2a2-bf2e5a9812f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063192 Aug 05 14:35:32.507803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 425/877] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:35:32.700068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:32.711021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a699879f-8da6-4bee-a83a-945a837441ce tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1758 microversion: 2.1 time: 0.275035 Aug 05 14:35:32.714940 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 453/878] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:32 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1758 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:35:38.399706 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:35:38.400603 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:35:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:35:38.827077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0bf0af5d-12de-4873-9462-d43c8e5fb485 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: .version_select at 0x7fa75d9eed30>, body: {"keypair": {"name": "tempest-keypair-148201452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtDq5tih9Q/qivseGb7WGTDwzb+SHIXV7pb5KDNCn3t+1iyC0s62J860oVMkzp7nwhnSmuJSa0wsDzp1Rb4KktcQdgJCs2H6pypdDf+L83BTtXugylcYjYNwUTHbhYI0A=="}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:38.832842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:38.849223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-0bf0af5d-12de-4873-9462-d43c8e5fb485 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:35:38.853339 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-0bf0af5d-12de-4873-9462-d43c8e5fb485 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:35:38.932628 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0bf0af5d-12de-4873-9462-d43c8e5fb485 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241864 Aug 05 14:35:38.933240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 426/879] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:35:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:41.126916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-998010858", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9d713f-ec54-40f7-9839-9e1dddc5814f"}], "security_groups": [{"name": "tempest-securitygroup--1755780084"}], "key_name": "tempest-keypair-148201452", "user_data": "}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:41.239218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] validate_networks() for [('bb9d713f-ec54-40f7-9839-9e1dddc5814f', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:35:41.697349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:35:41.697852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:35:41.698332 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:35:41.698774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:35:41.699183 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:35:41.709128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:41.709615 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:41.710117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:41.710846 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:41.711302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:41.711726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:41.730350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:35:41.734742 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:35:41.746071 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:35:41.748334 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:35:41.889189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0b3da42d-6e6d-4bd7-9e9f-0c296457ac76 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.767242 Aug 05 14:35:41.890377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 454/880] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:35:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:35:41.901988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a9db96ea-4e2a-4601-b24d-61bb8f7240a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:41.902729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a9db96ea-4e2a-4601-b24d-61bb8f7240a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:41.961513 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a9db96ea-4e2a-4601-b24d-61bb8f7240a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:41.971370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a9db96ea-4e2a-4601-b24d-61bb8f7240a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1240 microversion: 2.1 time: 0.073755 Aug 05 14:35:41.971963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 427/881] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:41 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:42.994441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:42.995104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:43.002117 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:43.002599 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:43.003039 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:43.003726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:43.004178 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:43.004632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:43.069142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:43.078004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4a74667d-b94b-431c-a8cb-c6e90988df88 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1244 microversion: 2.1 time: 0.087087 Aug 05 14:35:43.078588 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 455/882] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:42 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:44.099523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:44.100234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:44.102061 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=19 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:44.107526 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:44.108006 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:44.108793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:44.109493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:44.109963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:44.110432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:44.172988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:44.180724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4da87652-2d4f-439f-bc61-efa3c6f89394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1292 microversion: 2.1 time: 0.085089 Aug 05 14:35:44.181381 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 428/883] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:44 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:45.203502 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:45.204162 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:45.210719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:45.211201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:45.211636 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:45.212323 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:45.212799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:45.213226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:45.217203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=65 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:45.582133 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:45.589500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-12222c0e-9674-43aa-87ba-e87a9aa7df53 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.390787 Aug 05 14:35:45.590073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 456/884] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:45 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:45.832752 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-034aaf20-c7ae-4e95-9466-72496383513f req-974dbeb6-37b4-48aa-a3a1-2cb147d9b1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7c9c9f-0250-411b-8fdb-cbd85886ffc8", "tag": "538645fc-bbc1-4f81-bcb7-fde9a531dae5"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:45.842587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-034aaf20-c7ae-4e95-9466-72496383513f req-974dbeb6-37b4-48aa-a3a1-2cb147d9b1ec service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:45.843206 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-034aaf20-c7ae-4e95-9466-72496383513f req-974dbeb6-37b4-48aa-a3a1-2cb147d9b1ec service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:45.843638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-034aaf20-c7ae-4e95-9466-72496383513f req-974dbeb6-37b4-48aa-a3a1-2cb147d9b1ec service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:45.855478 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-034aaf20-c7ae-4e95-9466-72496383513f req-974dbeb6-37b4-48aa-a3a1-2cb147d9b1ec service nova] Creating event network-changed:538645fc-bbc1-4f81-bcb7-fde9a531dae5 for instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 on hv-cinder-80295 Aug 05 14:35:45.861163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-034aaf20-c7ae-4e95-9466-72496383513f req-974dbeb6-37b4-48aa-a3a1-2cb147d9b1ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032337 Aug 05 14:35:45.861969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 429/885] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:46.611146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:46.611758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:46.618235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:46.618717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:46.619152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:46.619840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:46.620384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:46.620838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:46.752436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:46.759838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-552f10dd-03b3-4e32-ba59-8a6db4b9aa42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.152671 Aug 05 14:35:46.760397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 457/886] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:46 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:47.781584 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:47.782322 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:47.788941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:47.789430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:47.789868 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:47.790562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:47.791019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:47.791449 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:47.923141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:47.930573 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-aa71cdf2-64ab-4862-8a8c-41314e36dfaa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.153444 Aug 05 14:35:47.931139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 430/887] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:47 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:48.951824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:48.952543 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:48.960015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:48.960532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:48.960974 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:48.961675 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:48.962132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:48.962620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:49.104478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:49.114506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1617154f-0d5d-47fe-85e8-7510bf895fee tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.166613 Aug 05 14:35:49.115091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 458/888] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:48 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:50.135646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:50.136291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:50.143482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:50.143953 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:50.144378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:50.145078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:50.145608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:50.146033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:50.278698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:50.286109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f3ab6481-bd43-4f66-b3e3-aeac974611c1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.154499 Aug 05 14:35:50.286667 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 431/889] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:50 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:51.306751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:51.307357 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:51.309659 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:51.314296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:51.314770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:51.315201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:51.315883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:51.316337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:51.321420 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:51.446259 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:51.454350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c95bd554-2836-40d3-90d6-4a62fd5c8e38 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.151441 Aug 05 14:35:51.454907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 459/890] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:51 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:52.475317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:52.475932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:52.478544 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:52.483317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:52.483797 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:52.484271 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:52.484980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:52.485466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:52.488252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:52.614285 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:52.621747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3bd02502-324f-4783-9f63-a84492603623 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.150519 Aug 05 14:35:52.622303 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 432/891] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:52 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:53.644010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:53.644750 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:53.646659 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:53.647321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:35:53.652511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:53.653005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:53.653450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:53.656634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:53.656634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:53.656634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:53.732095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-f7c2f6a0-e0ac-40a2-adff-7dd77a04a274 req-456fc9d1-0409-40d0-845a-8b8ab60504fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7c9c9f-0250-411b-8fdb-cbd85886ffc8", "name": "network-vif-plugged", "status": "completed", "tag": "538645fc-bbc1-4f81-bcb7-fde9a531dae5"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:53.743360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f7c2f6a0-e0ac-40a2-adff-7dd77a04a274 req-456fc9d1-0409-40d0-845a-8b8ab60504fa service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:53.743360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f7c2f6a0-e0ac-40a2-adff-7dd77a04a274 req-456fc9d1-0409-40d0-845a-8b8ab60504fa service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:53.743578 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f7c2f6a0-e0ac-40a2-adff-7dd77a04a274 req-456fc9d1-0409-40d0-845a-8b8ab60504fa service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:53.754693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-f7c2f6a0-e0ac-40a2-adff-7dd77a04a274 req-456fc9d1-0409-40d0-845a-8b8ab60504fa service nova] Creating event network-vif-plugged:538645fc-bbc1-4f81-bcb7-fde9a531dae5 for instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 on hv-cinder-80295 Aug 05 14:35:53.759732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-f7c2f6a0-e0ac-40a2-adff-7dd77a04a274 req-456fc9d1-0409-40d0-845a-8b8ab60504fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031436 Aug 05 14:35:53.760326 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 433/892] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:35:53.793597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:53.802079 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9a431791-6f3f-434f-95b2-fac9310f7c3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.162665 Aug 05 14:35:53.802646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 460/893] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:53 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:54.824662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:54.825301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:54.831479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:54.831950 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:54.832381 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:54.833113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:54.833563 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:54.833984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:54.965557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:54.974345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-13a78fcb-5065-41f7-83b6-5db35ffd56ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1366 microversion: 2.1 time: 0.154404 Aug 05 14:35:54.974909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 434/894] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:54 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:55.995743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:55.996392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:56.004778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:56.005267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:56.005702 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:56.006407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:56.006861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:56.007281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:56.138333 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:35:56.145968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a2fecd60-3799-4436-84ee-22eb006f070a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1555 microversion: 2.1 time: 0.154704 Aug 05 14:35:56.146527 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 461/895] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:35:55 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:35:56.166505 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:35:56.167021 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:35:56.173937 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:56.174413 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:56.174858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:56.175542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:56.175994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:56.176437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:56.252639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ac8cd940-d2cf-434e-9815-27b61a8c5465 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089983 Aug 05 14:35:56.253236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 435/896] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:35:56 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:35:57.283179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-cdbc6dde-1a08-40a0-850f-3c1bf049bcf9 req-6520eaef-d415-45a5-80bb-36a75d58f944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7c9c9f-0250-411b-8fdb-cbd85886ffc8", "tag": "538645fc-bbc1-4f81-bcb7-fde9a531dae5"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:35:57.292654 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-cdbc6dde-1a08-40a0-850f-3c1bf049bcf9 req-6520eaef-d415-45a5-80bb-36a75d58f944 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:35:57.293134 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-cdbc6dde-1a08-40a0-850f-3c1bf049bcf9 req-6520eaef-d415-45a5-80bb-36a75d58f944 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:35:57.293559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-cdbc6dde-1a08-40a0-850f-3c1bf049bcf9 req-6520eaef-d415-45a5-80bb-36a75d58f944 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:35:57.305752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-cdbc6dde-1a08-40a0-850f-3c1bf049bcf9 req-6520eaef-d415-45a5-80bb-36a75d58f944 service nova] Creating event network-changed:538645fc-bbc1-4f81-bcb7-fde9a531dae5 for instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 on hv-cinder-80295 Aug 05 14:35:57.310954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-cdbc6dde-1a08-40a0-850f-3c1bf049bcf9 req-6520eaef-d415-45a5-80bb-36a75d58f944 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093940 Aug 05 14:35:57.311752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 462/897] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:36:03.099436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:03.106870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:03.107388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:03.107872 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:03.108303 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:03.109017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:03.109469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:03.109889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:03.138109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-236dd75a-bd17-4b33-8ebf-c061f14b777f tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043264 Aug 05 14:36:03.138819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 436/898] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Aug 5 14:36:03 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:03.200363 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:03.200978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:03.208288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:03.208797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:03.209234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:03.209923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:03.210379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:03.210806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:03.235050 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:36:03.542328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e071ff99-7f7a-41da-a1d9-6d774b424974 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 204 len: 0 microversion: 2.20 time: 0.345780 Aug 05 14:36:03.542927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 463/899] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Aug 5 14:36:03 2022] DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 14:36:03.551789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:03.555248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:03.558362 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:03.558848 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:03.559293 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:03.559987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:03.560465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:03.560898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:03.690907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:03.699064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:03.700684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:03.701850 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-00dde54b-950c-4d14-b6c6-ff96aa82bfd9 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.154562 Aug 05 14:36:03.702404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 437/900] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:03 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:36:04.726972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:04.727667 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:04.734128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:04.734605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:04.735038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:04.736304 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:04.736776 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:04.737197 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:04.867765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:04.875978 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:04.877563 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:04.878806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-62c8d9b8-12cd-4f2e-8e95-19b426ade730 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1723 microversion: 2.20 time: 0.156269 Aug 05 14:36:04.879399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 464/901] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:04 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:36:05.901889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:05.902502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:05.920706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:05.920706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:05.920706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:05.920706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:05.923551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:05.923551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:05.984080 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:05.992896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:05.994399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:05.995556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ba98b6f2-abd9-4316-b5bc-bc4da3aeab5c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1655 microversion: 2.20 time: 0.097855 Aug 05 14:36:05.996118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 438/902] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:05 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 14:36:06.249776 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-56e442b5-b8f0-40b9-979c-08db4715081c req-0be58438-1931-4259-be4a-959d504a18e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990c9dca-a1be-4bf2-9015-e4f83ddf357c", "name": "network-vif-deleted", "tag": "47d502bd-9fb0-47dd-9af9-5e1d6c762264"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:36:06.259952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-56e442b5-b8f0-40b9-979c-08db4715081c req-0be58438-1931-4259-be4a-959d504a18e4 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:06.268165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-56e442b5-b8f0-40b9-979c-08db4715081c req-0be58438-1931-4259-be4a-959d504a18e4 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:06.268165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-56e442b5-b8f0-40b9-979c-08db4715081c req-0be58438-1931-4259-be4a-959d504a18e4 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:06.273537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-56e442b5-b8f0-40b9-979c-08db4715081c req-0be58438-1931-4259-be4a-959d504a18e4 service nova] Creating event network-vif-deleted:47d502bd-9fb0-47dd-9af9-5e1d6c762264 for instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c on hv-cinder-80295 Aug 05 14:36:06.278695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-56e442b5-b8f0-40b9-979c-08db4715081c req-0be58438-1931-4259-be4a-959d504a18e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093800 Aug 05 14:36:06.279552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 465/903] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:36:07.019654 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:07.020547 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:07.027175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:07.027662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:07.028208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:07.028992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:07.029473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:07.029865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:07.068909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:07.069313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:07.069750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:07.070202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lazy-loading 'fault' on Instance uuid 990c9dca-a1be-4bf2-9015-e4f83ddf357c {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:36:07.118928 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:07.127682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:07.129243 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '084b18670c2a4c1396d5912d130b2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13896c64e44b60838d3f313407433f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:07.130401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e153a50f-3328-47b9-991d-0abedefb78d4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 200 len: 1371 microversion: 2.20 time: 0.115115 Aug 05 14:36:07.130970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 439/904] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:07 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 14:36:08.154750 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:08.155444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:08.161757 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:08.162235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:08.162666 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:08.163345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:08.163794 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:08.164214 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:08.177301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] HTTP exception thrown: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Request method failure captured: Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c HTTP/1.1 Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShXpBYryf6pTMHfsvnaYllcDyTP2OoQqG2GQJhK9scDJA4A8V83mPPyixp8POAsPHGbprZ6CvFs1gj5S4owV0Hc_-yxS8lg3i4l2YzLqGO9hVmCV91iwi-e3ZTT_Wn_gcukKgUS-0WSBKKt5B1hrggSU7IyGkh-Xf_awecb_xYeCHU Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:36:08.178929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13896c64e44b60838d3f313407433f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13896c64e44b60838d3f313407433f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 084b18670c2a4c1396d5912d130b2bac Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:08.180738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '990c9dca-a1be-4bf2-9015-e4f83ddf357c'} Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:08.181789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:08.183322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:08.185003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Returning 404 to user: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:08.185003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-757cd477-5f2c-477c-86ce-b36391127f70 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 404 len: 111 microversion: 2.20 time: 0.030313 Aug 05 14:36:08.185003 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 466/905] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:08 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:08.189192 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e25e084e-abf3-4d1c-a930-b97c7c460237 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '.version_select at 0x7fa75d9ee040>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:08.291907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e25e084e-abf3-4d1c-a930-b97c7c460237 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406816309" status: 204 len: 0 microversion: 2.20 time: 0.106513 Aug 05 14:36:08.292528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 440/906] 10.222.0.26 () {60 vars in 1262 bytes} [Fri Aug 5 14:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406816309 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 14:36:10.258431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:10.272002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:10.272002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:10.272002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:10.272002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:10.272447 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:10.272447 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:10.272447 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:10.281167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] HTTP exception thrown: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Request method failure captured: Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c HTTP/1.1 Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShXpBYryf6pTMHfsvnaYllcDyTP2OoQqG2GQJhK9scDJA4A8V83mPPyixp8POAsPHGbprZ6CvFs1gj5S4owV0Hc_-yxS8lg3i4l2YzLqGO9hVmCV91iwi-e3ZTT_Wn_gcukKgUS-0WSBKKt5B1hrggSU7IyGkh-Xf_awecb_xYeCHU Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:36:10.282692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13896c64e44b60838d3f313407433f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13896c64e44b60838d3f313407433f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 084b18670c2a4c1396d5912d130b2bac Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.284929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '990c9dca-a1be-4bf2-9015-e4f83ddf357c'} Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:10.285841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.287326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.289021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Returning 404 to user: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:10.289021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a1e985bd-757e-40b0-897a-8f826cf8af3b tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 404 len: 111 microversion: 2.20 time: 0.029713 Aug 05 14:36:10.289021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 467/907] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Aug 5 14:36:10 2022] DELETE /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:10.293766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:10.294400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 990c9dca-a1be-4bf2-9015-e4f83ddf357c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:10.301485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:10.301962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:10.302388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:10.303064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:10.303509 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:10.303925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:10.316992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] HTTP exception thrown: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Request method failure captured: Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c HTTP/1.1 Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShXpBYryf6pTMHfsvnaYllcDyTP2OoQqG2GQJhK9scDJA4A8V83mPPyixp8POAsPHGbprZ6CvFs1gj5S4owV0Hc_-yxS8lg3i4l2YzLqGO9hVmCV91iwi-e3ZTT_Wn_gcukKgUS-0WSBKKt5B1hrggSU7IyGkh-Xf_awecb_xYeCHU Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:36:10.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13896c64e44b60838d3f313407433f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13896c64e44b60838d3f313407433f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 084b18670c2a4c1396d5912d130b2bac Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.320254 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '990c9dca-a1be-4bf2-9015-e4f83ddf357c'} Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:10.321208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. Aug 05 14:36:10.322668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:10.323995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Returning 404 to user: Instance 990c9dca-a1be-4bf2-9015-e4f83ddf357c could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:10.323995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-998ea5aa-0778-4357-a545-2b42337cc38c tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c" status: 404 len: 111 microversion: 2.20 time: 0.030648 Aug 05 14:36:10.323995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 441/908] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:10 2022] GET /compute/v2.1/servers/990c9dca-a1be-4bf2-9015-e4f83ddf357c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:11.576642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:11.577170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:11.583534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:11.584015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:11.584480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:11.585173 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:11.585628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:11.586051 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:11.599875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] HTTP exception thrown: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Request method failure captured: Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f HTTP/1.1 Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7ShXpBYryf6pTMHfsvnaYllcDyTP2OoQqG2GQJhK9scDJA4A8V83mPPyixp8POAsPHGbprZ6CvFs1gj5S4owV0Hc_-yxS8lg3i4l2YzLqGO9hVmCV91iwi-e3ZTT_Wn_gcukKgUS-0WSBKKt5B1hrggSU7IyGkh-Xf_awecb_xYeCHU Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:36:11.601435 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13896c64e44b60838d3f313407433f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13896c64e44b60838d3f313407433f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 084b18670c2a4c1396d5912d130b2bac Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.603101 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '6d0b0a47-053b-4f94-ab1b-b801a7e86b6f'} Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:11.603980 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.605518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.607244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Returning 404 to user: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:11.607244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7aeb6e63-524d-4747-a15c-31f70b8c5df7 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 404 len: 111 microversion: 2.20 time: 0.030153 Aug 05 14:36:11.607244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 468/909] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Aug 5 14:36:11 2022] DELETE /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:11.611274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:11.611882 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] [instance: 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:11.618921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:11.619397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:11.619830 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:11.620556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:11.621011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:11.621433 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:11.635068 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] HTTP exception thrown: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Request method failure captured: Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f HTTP/1.1 Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7ShXpBYryf6pTMHfsvnaYllcDyTP2OoQqG2GQJhK9scDJA4A8V83mPPyixp8POAsPHGbprZ6CvFs1gj5S4owV0Hc_-yxS8lg3i4l2YzLqGO9hVmCV91iwi-e3ZTT_Wn_gcukKgUS-0WSBKKt5B1hrggSU7IyGkh-Xf_awecb_xYeCHU Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:36:11.636678 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13896c64e44b60838d3f313407433f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13896c64e44b60838d3f313407433f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13896c64e44b60838d3f313407433f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 5c13896c64e44b60838d3f313407433f Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743137237 Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 084b18670c2a4c1396d5912d130b2bac Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743137237-project Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.638432 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '6d0b0a47-053b-4f94-ab1b-b801a7e86b6f'} Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:11.639330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. Aug 05 14:36:11.640799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:11.642144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] Returning 404 to user: Instance 6d0b0a47-053b-4f94-ab1b-b801a7e86b6f could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:11.642144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b3e03f34-be3b-4076-908b-ba5295addcf4 tempest-AttachVolumeShelveTestJSON-1743137237 tempest-AttachVolumeShelveTestJSON-1743137237-project] 10.222.0.26 "GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f" status: 404 len: 111 microversion: 2.20 time: 0.030592 Aug 05 14:36:11.642144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 442/910] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Aug 5 14:36:11 2022] GET /compute/v2.1/servers/6d0b0a47-053b-4f94-ab1b-b801a7e86b6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:16.861418 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-400461a6-75d2-41aa-920b-b7a3518a78aa tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Action: 'create', calling method: .version_select at 0x7fa75d312940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-461765966", "metadata": {"Type": "work"}}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-400461a6-75d2-41aa-920b-b7a3518a78aa tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Request method failure captured: Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 121 Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SrgP7-ri3m6LPymYTmIvBxwGVbaoR04FAiLSAbpCP8Mu0rQ01-m_HVdsZtm1GZ_TMdPZBL3Gp6mKYUjpHOm4Mv-vpnkONwWvAKQESmHedIfjYvDi8mxviv5qxTV6i705HpURJrIXGBw7-nZEGVFyAyCc3NfrbxiFVDIfVjCMUBwcFc Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:36:16.874844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01b3aa5e1464228ac9c4efc1a24a419", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 6fe31b19c15949daa1a6afe88538c2c1 Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-461765966", "metadata": {"Type": "work"}}} Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: Aug 05 14:36:16.876524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-461765966', 'metadata': {'Type': 'work'}}}} Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise error Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:16.877524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 14:36:16.879835 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 14:36:16.881205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 14:36:16.881205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.881205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-400461a6-75d2-41aa-920b-b7a3518a78aa tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:16.881205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-400461a6-75d2-41aa-920b-b7a3518a78aa tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125448 Aug 05 14:36:16.881205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 469/911] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Aug 5 14:36:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:16.886837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4d187cc9-3699-43c6-9a68-0b903853f610 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Action: 'create', calling method: .version_select at 0x7fa75d9843a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1126683742", "metadata": {"Type": "work"}}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4d187cc9-3699-43c6-9a68-0b903853f610 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Request method failure captured: Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 120 Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7SrgP7-ri3m6LPymYTmIvBxwGVbaoR04FAiLSAbpCP8Mu0rQ01-m_HVdsZtm1GZ_TMdPZBL3Gp6mKYUjpHOm4Mv-vpnkONwWvAKQESmHedIfjYvDi8mxviv5qxTV6i705HpURJrIXGBw7-nZEGVFyAyCc3NfrbxiFVDIfVjCMUBwcFc Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:36:16.891390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01b3aa5e1464228ac9c4efc1a24a419", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 6fe31b19c15949daa1a6afe88538c2c1 Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1126683742", "metadata": {"Type": "work"}}} Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: Aug 05 14:36:16.892984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1126683742', 'metadata': {'Type': 'work'}}}} Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise error Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi '0' Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:16.894077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 14:36:16.895695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 14:36:16.897150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 14:36:16.897150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.897150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4d187cc9-3699-43c6-9a68-0b903853f610 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:16.897150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4d187cc9-3699-43c6-9a68-0b903853f610 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010004 Aug 05 14:36:16.897150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 443/912] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Aug 5 14:36:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:16.903878 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-49211b27-4ddd-4358-8316-fbbca8bce6b7 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Action: 'create', calling method: .version_select at 0x7fa75d3a1af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-708690290", "metadata": {"Type": "work"}}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-49211b27-4ddd-4358-8316-fbbca8bce6b7 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Request method failure captured: Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 118 Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SrgP7-ri3m6LPymYTmIvBxwGVbaoR04FAiLSAbpCP8Mu0rQ01-m_HVdsZtm1GZ_TMdPZBL3Gp6mKYUjpHOm4Mv-vpnkONwWvAKQESmHedIfjYvDi8mxviv5qxTV6i705HpURJrIXGBw7-nZEGVFyAyCc3NfrbxiFVDIfVjCMUBwcFc Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:36:16.908479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01b3aa5e1464228ac9c4efc1a24a419", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 6fe31b19c15949daa1a6afe88538c2c1 Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-708690290", "metadata": {"Type": "work"}}} Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: Aug 05 14:36:16.910301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-708690290', 'metadata': {'Type': 'work'}}}} Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise error Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi '' Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:16.911966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 14:36:16.913494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 14:36:16.914888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 14:36:16.914888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.914888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-49211b27-4ddd-4358-8316-fbbca8bce6b7 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:16.914888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-49211b27-4ddd-4358-8316-fbbca8bce6b7 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009769 Aug 05 14:36:16.914888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 470/913] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Aug 5 14:36:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:36:16.919451 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8638966a-d175-4e35-8acb-6df20241b4b2 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Calling method '.version_select at 0x7fa75d963670>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:16.950331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-8638966a-d175-4e35-8acb-6df20241b4b2 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] HTTP exception thrown: Volume tempest-invalid-1369510796 could not be found. Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8638966a-d175-4e35-8acb-6df20241b4b2 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Request method failure captured: Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1369510796 HTTP/1.1 Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7SrgP7-ri3m6LPymYTmIvBxwGVbaoR04FAiLSAbpCP8Mu0rQ01-m_HVdsZtm1GZ_TMdPZBL3Gp6mKYUjpHOm4Mv-vpnkONwWvAKQESmHedIfjYvDi8mxviv5qxTV6i705HpURJrIXGBw7-nZEGVFyAyCc3NfrbxiFVDIfVjCMUBwcFc Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:36:16.952246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01b3aa5e1464228ac9c4efc1a24a419", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 6fe31b19c15949daa1a6afe88538c2c1 Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Volume tempest-invalid-1369510796 could not be found. Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'tempest-invalid-1369510796'} Aug 05 14:36:16.953831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1369510796 could not be found. (HTTP 404) (Request-ID: req-b2771c8e-8379-47be-b86e-ecf792ff6096) Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.954738 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 14:36:16.956231 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1369510796 could not be found. Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:16.957569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1369510796 could not be found. Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1369510796 could not be found. Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8638966a-d175-4e35-8acb-6df20241b4b2 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Returning 404 to user: Volume tempest-invalid-1369510796 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8638966a-d175-4e35-8acb-6df20241b4b2 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1369510796" status: 404 len: 99 microversion: 2.1 time: 0.038352 Aug 05 14:36:16.958931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 444/914] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Aug 5 14:36:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1369510796 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 14:36:16.963166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-29543e10-afdb-43c8-b876-f827b1878d8c tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003761 Aug 05 14:36:16.963844 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 471/915] 10.222.0.26 () {58 vars in 1140 bytes} [Fri Aug 5 14:36:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 14:36:16.971897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5bff198d-f8ff-4dca-a832-1b6beb41c39e tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003828 Aug 05 14:36:16.972380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 445/916] 10.222.0.26 () {58 vars in 1137 bytes} [Fri Aug 5 14:36:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 14:36:16.980524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-404ff9ea-21ba-45a3-93b2-babe7e497594 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Calling method '.version_select at 0x7fa75d107040>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:17.009247 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-404ff9ea-21ba-45a3-93b2-babe7e497594 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] HTTP exception thrown: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-404ff9ea-21ba-45a3-93b2-babe7e497594 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Request method failure captured: Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: DELETE /compute/v2.1/os-volumes/293db6f8-e340-4d03-a27e-2517d524b16d HTTP/1.1 Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SrgP7-ri3m6LPymYTmIvBxwGVbaoR04FAiLSAbpCP8Mu0rQ01-m_HVdsZtm1GZ_TMdPZBL3Gp6mKYUjpHOm4Mv-vpnkONwWvAKQESmHedIfjYvDi8mxviv5qxTV6i705HpURJrIXGBw7-nZEGVFyAyCc3NfrbxiFVDIfVjCMUBwcFc Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:36:17.011234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01b3aa5e1464228ac9c4efc1a24a419", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 6fe31b19c15949daa1a6afe88538c2c1 Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '293db6f8-e340-4d03-a27e-2517d524b16d'} Aug 05 14:36:17.012827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. (HTTP 404) (Request-ID: req-521bb166-2c34-4ba7-a2bb-688f895c9ef2) Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:17.013817 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 14:36:17.015212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 14:36:17.017860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-404ff9ea-21ba-45a3-93b2-babe7e497594 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Returning 404 to user: Volume 293db6f8-e340-4d03-a27e-2517d524b16d could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-404ff9ea-21ba-45a3-93b2-babe7e497594 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/293db6f8-e340-4d03-a27e-2517d524b16d" status: 404 len: 109 microversion: 2.1 time: 0.035693 Aug 05 14:36:17.026315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 472/917] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:36:16 2022] DELETE /compute/v2.1/os-volumes/293db6f8-e340-4d03-a27e-2517d524b16d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:36:17.027363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b68ae42f-afb3-4829-9cef-af56b0890699 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Calling method '.version_select at 0x7fa75d9ee430>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:17.051252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-b68ae42f-afb3-4829-9cef-af56b0890699 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] HTTP exception thrown: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b68ae42f-afb3-4829-9cef-af56b0890699 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Request method failure captured: Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/os-volumes/43f46944-4396-455d-95ae-8d2e2e4665d7 HTTP/1.1 Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7SrgP7-ri3m6LPymYTmIvBxwGVbaoR04FAiLSAbpCP8Mu0rQ01-m_HVdsZtm1GZ_TMdPZBL3Gp6mKYUjpHOm4Mv-vpnkONwWvAKQESmHedIfjYvDi8mxviv5qxTV6i705HpURJrIXGBw7-nZEGVFyAyCc3NfrbxiFVDIfVjCMUBwcFc Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:36:17.053224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01b3aa5e1464228ac9c4efc1a24a419", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01b3aa5e1464228ac9c4efc1a24a419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: b01b3aa5e1464228ac9c4efc1a24a419 Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesNegativeTest-852298498 Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 6fe31b19c15949daa1a6afe88538c2c1 Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesNegativeTest-852298498-project Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '43f46944-4396-455d-95ae-8d2e2e4665d7'} Aug 05 14:36:17.054787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. (HTTP 404) (Request-ID: req-5f8b30b0-3ea7-4600-9205-2ae8de453068) Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:17.055821 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 14:36:17.057355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 14:36:17.058658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b68ae42f-afb3-4829-9cef-af56b0890699 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] Returning 404 to user: Volume 43f46944-4396-455d-95ae-8d2e2e4665d7 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b68ae42f-afb3-4829-9cef-af56b0890699 tempest-VolumesNegativeTest-852298498 tempest-VolumesNegativeTest-852298498-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/43f46944-4396-455d-95ae-8d2e2e4665d7" status: 404 len: 109 microversion: 2.1 time: 0.035002 Aug 05 14:36:17.059976 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 446/918] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Aug 5 14:36:17 2022] GET /compute/v2.1/os-volumes/43f46944-4396-455d-95ae-8d2e2e4665d7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:36:44.063263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:36:44.064035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:36:44.068991 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:36:44.071253 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:44.077113 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:44.077596 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:44.078063 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:44.078750 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:44.079206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:44.079630 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:44.324019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eaa14fac-a49c-4c88-92ec-f7f5eccd75c6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/action" status: 202 len: 0 microversion: 2.1 time: 0.261670 Aug 05 14:36:44.324795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 473/919] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:36:44 2022] POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:36:44.331118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:36:44.332079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=68 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:36:44.337562 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:44.338169 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:44.344256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:44.344774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:44.345267 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:44.345973 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:44.346420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:44.346837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:44.490013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:44.498002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1049bb71-1449-4c99-a1d3-0c02bb0f205c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1750 microversion: 2.1 time: 0.168732 Aug 05 14:36:44.498556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 447/920] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:44 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:45.521547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:45.522374 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:45.529005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:45.529493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:45.529933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:45.530631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:45.531123 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:45.531548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:45.678814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:45.686968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ddb81abd-0c07-43cd-b76b-ecfdabf28208 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1750 microversion: 2.1 time: 0.171518 Aug 05 14:36:45.687552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 474/921] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:45 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:46.710112 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:46.710724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:46.718365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:46.719119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:46.719559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:46.720259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:46.720748 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:46.721177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:46.865799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:46.873648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-58a4c639-1e19-4fe3-9892-183c44a88a31 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1750 microversion: 2.1 time: 0.168049 Aug 05 14:36:46.874208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 448/922] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:46 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:47.894775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:47.896330 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:47.902998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:47.903472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:47.903916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:47.904611 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:47.905059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:47.905558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:48.056788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:48.064734 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-82e011cf-77f6-459e-a575-325612f4094a tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.173809 Aug 05 14:36:48.065288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 475/923] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:47 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:49.086154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:49.086855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:49.093418 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:49.094176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:49.094611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:49.095310 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:49.095766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:49.096191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:49.275716 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:49.283825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-55439588-2f09-4645-bd02-4a325212f4bc tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.201533 Aug 05 14:36:49.287354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 449/924] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:49 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:50.304556 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:50.305209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:50.311597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:50.312083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:50.312558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:50.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:50.313711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:50.314144 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:50.453090 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:50.461551 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-948fe2c3-1e0b-45ff-b49a-28af10590676 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.161106 Aug 05 14:36:50.462106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 476/925] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:50 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:51.482757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:51.483393 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:51.489994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:51.490475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:51.490907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:51.491590 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:51.492042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:51.492489 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:51.638839 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:51.647477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-20677386-dfb2-456f-af8d-5a598523743d tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.168589 Aug 05 14:36:51.648036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 450/926] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:51 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:52.669057 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:52.669679 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:52.676644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:52.677142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:52.677578 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:52.678274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:52.678732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:52.679159 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:52.821628 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:52.829549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eee1b924-e8d5-4a54-a8c6-a539eb12e50b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.164447 Aug 05 14:36:52.830115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 477/927] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:52 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:53.850465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:53.851110 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:53.857693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:53.858178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:53.858608 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:53.859312 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:53.859756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:53.860173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:54.003136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:54.011633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b52a8791-ba9b-4f8d-a3cc-f1f8628d803e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.165017 Aug 05 14:36:54.012186 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 451/928] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:53 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:55.033916 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:55.034561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:55.041758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:55.042242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:55.042687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:55.043379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:55.043840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:55.044267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:55.185488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:55.193487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-977828b1-ae23-4dec-9aa1-3ed310df649c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.163472 Aug 05 14:36:55.194051 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 478/929] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:55 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:56.214387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:56.214980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:56.221636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:56.224176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:56.224176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:56.224176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:56.224176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:56.224600 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:56.364663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:56.372701 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a49a7cee-91b6-413b-96b4-f859d81cefd9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.162050 Aug 05 14:36:56.373245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 452/930] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:56 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:57.393865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:57.394473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:57.400945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:57.401420 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:57.401850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:57.402531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:57.402983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:57.403402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:57.554213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:57.562278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-82039b56-bb7a-4b9b-83a1-764af1c94dae tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.172266 Aug 05 14:36:57.563067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 479/931] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:57 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:58.584978 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:58.585579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:58.591901 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:58.592375 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:58.592839 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:58.593515 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:58.594222 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:58.594639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:58.735145 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:58.743219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b5ba3a7c-bcec-4108-90b1-8cfbca59f77f tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.162810 Aug 05 14:36:58.743794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 453/932] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:58 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:36:59.764631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:36:59.769249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:36:59.771601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:59.772088 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:59.772550 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:59.773915 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:36:59.774377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:36:59.774804 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:36:59.921922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:36:59.929970 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1d6cc29f-2efc-47bb-aca0-173c1b5b102e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.169262 Aug 05 14:36:59.930525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 480/933] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:36:59 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:00.951114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:00.951718 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:00.958049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:00.958528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:00.958956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:00.959663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:00.960111 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:00.961154 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:01.180038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:01.188022 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6a0d011a-45a5-48f3-b9d8-35c6579b8c75 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.240812 Aug 05 14:37:01.188623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 454/934] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:00 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:02.209502 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:02.210197 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:02.216581 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:02.217082 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:02.217525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:02.218237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:02.218997 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:02.219428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:02.368866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:02.376911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9ea8f558-2c87-4d80-911f-ee72d3529da5 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.171159 Aug 05 14:37:02.377518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 481/935] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:02 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:03.399881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:03.412092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:03.412092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:03.412092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:03.412092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:03.412543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:03.412543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:03.412543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:03.560872 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:03.568764 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-cb017317-24e5-4116-b269-84f8e8451a73 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1755 microversion: 2.1 time: 0.174582 Aug 05 14:37:03.569337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 455/936] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:03 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:04.590031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:04.590674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:04.597343 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:04.597831 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:04.598268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:04.598953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:04.599409 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:04.599834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:04.746384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:04.758577 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-76ca7d4e-8805-42af-9a08-b30eb63b062c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1758 microversion: 2.1 time: 0.171500 Aug 05 14:37:04.759096 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 482/937] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:04 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:43.384695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-904117282", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "networks": [{"uuid": "368e4eb1-4106-43a2-b8e8-506787184733"}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:37:43.393756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=18 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:43.394425 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=54 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:43.439213 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] validate_networks() for [('368e4eb1-4106-43a2-b8e8-506787184733', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:37:43.841054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:37:43.841472 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:37:43.841992 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:37:43.842401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:37:43.842805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:37:43.851588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:43.852062 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:43.852528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:43.853241 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:43.853690 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:43.854106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:43.872557 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Getting quotas for project 58c88a9de1de4e2b83bb8a37142608a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:37:43.876399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Getting quotas for user 4552c0df2a3f4f30b6b2829de3a8284d and project 58c88a9de1de4e2b83bb8a37142608a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:37:43.887959 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:37:43.890174 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:37:44.057229 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-25fe734c-4e49-4ddd-9efa-8c5d0d7d65ff tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676438 Aug 05 14:37:44.058392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 456/938] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:37:44.069620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-37e5c0cf-ec2b-4ced-97b3-685748353ffe tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:44.070292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-37e5c0cf-ec2b-4ced-97b3-685748353ffe tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:44.072533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=20 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:44.073209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:44.124576 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-37e5c0cf-ec2b-4ced-97b3-685748353ffe tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:44.131803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-37e5c0cf-ec2b-4ced-97b3-685748353ffe tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1213 microversion: 2.1 time: 0.066189 Aug 05 14:37:44.132378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 483/939] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:44 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:45.155286 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:45.155894 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:45.162692 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:45.163208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:45.163650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:45.164370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:45.164858 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:45.165483 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:45.226253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:45.234328 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6e631607-c26d-4c44-9758-48e3991d4dc3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1217 microversion: 2.1 time: 0.083072 Aug 05 14:37:45.234889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 457/940] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:45 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:46.255781 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:46.256402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:46.262604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:46.263699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:46.264185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:46.264910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:46.265361 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:46.265791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:46.329890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:46.338579 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9bafd8f7-36bb-4c38-9dfc-4c13cd3f4335 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1273 microversion: 2.1 time: 0.087229 Aug 05 14:37:46.339217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 484/941] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:46 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:47.359862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:47.360499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:47.366949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:47.367431 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:47.367871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:47.368589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:47.369044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:47.369469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:47.503789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:47.511430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e1772718-907c-4228-bc8b-deb60502e85b tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.156198 Aug 05 14:37:47.525767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 458/942] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:47 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:47.670962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-17a981ad-b5d6-4306-a649-d6ac896bdb33 req-a5db084e-6904-4e6c-9904-39fb59e862d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb96fee-b681-4447-9387-403787cc34d5", "tag": "54b0fdff-ba0f-40f7-a5d6-85446cb77fb1"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:37:47.682906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-17a981ad-b5d6-4306-a649-d6ac896bdb33 req-a5db084e-6904-4e6c-9904-39fb59e862d3 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:47.683364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-17a981ad-b5d6-4306-a649-d6ac896bdb33 req-a5db084e-6904-4e6c-9904-39fb59e862d3 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:47.683787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-17a981ad-b5d6-4306-a649-d6ac896bdb33 req-a5db084e-6904-4e6c-9904-39fb59e862d3 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:47.698764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-17a981ad-b5d6-4306-a649-d6ac896bdb33 req-a5db084e-6904-4e6c-9904-39fb59e862d3 service nova] Creating event network-changed:54b0fdff-ba0f-40f7-a5d6-85446cb77fb1 for instance cdb96fee-b681-4447-9387-403787cc34d5 on hv-cinder-80295 Aug 05 14:37:47.703716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-17a981ad-b5d6-4306-a649-d6ac896bdb33 req-a5db084e-6904-4e6c-9904-39fb59e862d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037156 Aug 05 14:37:47.704533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 485/943] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:37:48.532734 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:48.533405 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:48.539819 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:48.540307 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:48.540812 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:48.541543 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:48.541994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:48.542418 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:48.672912 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:48.681235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2d180c19-d5ca-4fc3-9e41-766eafb6be55 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.151710 Aug 05 14:37:48.686493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 459/944] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:48 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:49.705204 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:49.705910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:49.712858 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:49.713347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:49.713832 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:49.715064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:49.715531 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:49.716053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:49.864682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:49.873960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-891063da-6360-4ce3-8928-7d4ec3472a02 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.175339 Aug 05 14:37:49.874543 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 486/945] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:49 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:50.895038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:50.895643 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:50.902047 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:50.902530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:50.902963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:50.903698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:50.904104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:50.904586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:51.033653 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:51.040988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-44c5285a-8255-4f22-829f-fbbeb995d89f tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.149812 Aug 05 14:37:51.041551 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 460/946] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:50 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:37:52.062747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:52.063388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:52.069793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:52.070280 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:52.070717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:52.071425 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:52.071860 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:52.072285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:52.201154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:52.210297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1fd98081-e527-4be5-8d6b-6384a239e5a4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.152314 Aug 05 14:37:52.210814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 487/947] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:52 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:53.231669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:53.232487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:53.240004 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:53.240824 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:53.241326 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:53.242092 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:53.242662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:53.243147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:53.379579 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:53.387216 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c29d390b-b986-4365-959d-6ef5e0c9881e tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.159474 Aug 05 14:37:53.387781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 461/948] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:53 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:54.411953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:54.412678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:54.415256 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:54.420350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:54.421005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:54.421449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:54.422168 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:54.422638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:54.423119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:54.437542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:54.438395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:37:54.568891 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:54.578701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e259b03c-199a-4c7f-9311-bae88baa1d37 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.171538 Aug 05 14:37:54.578701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 488/949] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:54 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:54.590269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-22091fd2-0db6-43cc-b4da-70ab6c7a2c2a req-b98889db-664c-4270-a8b5-c9a59fa683c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb96fee-b681-4447-9387-403787cc34d5", "name": "network-vif-plugged", "status": "completed", "tag": "54b0fdff-ba0f-40f7-a5d6-85446cb77fb1"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:37:54.600811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-22091fd2-0db6-43cc-b4da-70ab6c7a2c2a req-b98889db-664c-4270-a8b5-c9a59fa683c0 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:54.601411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-22091fd2-0db6-43cc-b4da-70ab6c7a2c2a req-b98889db-664c-4270-a8b5-c9a59fa683c0 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:54.601914 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-22091fd2-0db6-43cc-b4da-70ab6c7a2c2a req-b98889db-664c-4270-a8b5-c9a59fa683c0 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:54.613897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-22091fd2-0db6-43cc-b4da-70ab6c7a2c2a req-b98889db-664c-4270-a8b5-c9a59fa683c0 service nova] Creating event network-vif-plugged:54b0fdff-ba0f-40f7-a5d6-85446cb77fb1 for instance cdb96fee-b681-4447-9387-403787cc34d5 on hv-cinder-80295 Aug 05 14:37:54.619384 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-22091fd2-0db6-43cc-b4da-70ab6c7a2c2a req-b98889db-664c-4270-a8b5-c9a59fa683c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187634 Aug 05 14:37:54.619978 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 462/950] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:37:55.599496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:55.600262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:55.606475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:55.606959 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:55.607394 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:55.608194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:55.608680 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:55.609115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:55.742624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:55.750818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7c8c67dd-2b15-40af-83fa-c6c0976c7df1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.155173 Aug 05 14:37:55.751480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 489/951] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:55 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:56.771735 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:56.772325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:56.778404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:56.778879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:56.779310 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:56.780609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:56.781065 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:56.781486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:56.910087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:56.917741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-76f50ffc-d939-4aea-8290-10aa03294609 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1313 microversion: 2.1 time: 0.150775 Aug 05 14:37:56.918292 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 463/952] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:56 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:57.938749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:57.939362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:57.945769 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:57.946250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:57.946692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:57.947381 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:57.947840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:57.948271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:58.081032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:58.088999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-5fdbb168-7236-4776-aaf7-ee2ca0b98a49 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1497 microversion: 2.1 time: 0.154872 Aug 05 14:37:58.089613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 490/953] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:57 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:37:59.031523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:59.032070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:59.038555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:59.039893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:59.039893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:59.040232 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:59.040719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:59.041137 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:59.067118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:37:59.236329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:59.236892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:59.243274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:59.243756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:59.244190 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:59.244914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:59.245373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:59.245799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:59.269507 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0e41c795-2b9a-45ce-b7d4-f3a2304b9e44 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/ips" status: 200 len: 149 microversion: 2.1 time: 0.037137 Aug 05 14:37:59.270802 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 491/954] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:37:59 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:37:59.341537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b0f1376c-f833-4c26-b11d-41d3f79eb4e3 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 204 len: 0 microversion: 2.1 time: 0.314416 Aug 05 14:37:59.342969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 464/955] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:37:59 2022] DELETE /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:37:59.351568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:37:59.352235 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:37:59.358764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:59.359251 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:59.359688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:59.360383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:37:59.360862 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:37:59.361289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:37:59.492480 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:37:59.501344 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-89316fde-1732-43d7-aa0e-076ed43ab85d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1503 microversion: 2.1 time: 0.153956 Aug 05 14:37:59.501903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 492/956] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:37:59 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:00.523689 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:00.524395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:00.532131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:00.532648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:00.533087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:00.533775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:00.534226 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:00.534646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:00.661279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:00.668834 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-19206600-be75-4afa-ba1f-a43c1aae2618 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1503 microversion: 2.1 time: 0.149296 Aug 05 14:38:00.669404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 465/957] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:00 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:01.654988 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-eb535a7d-b3d7-4b22-8adb-50167342384c req-228867ab-dbf1-443a-ac5f-23e5643f7658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb96fee-b681-4447-9387-403787cc34d5", "name": "network-vif-deleted", "tag": "54b0fdff-ba0f-40f7-a5d6-85446cb77fb1"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:01.664658 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-eb535a7d-b3d7-4b22-8adb-50167342384c req-228867ab-dbf1-443a-ac5f-23e5643f7658 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:01.665142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-eb535a7d-b3d7-4b22-8adb-50167342384c req-228867ab-dbf1-443a-ac5f-23e5643f7658 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:01.665568 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-eb535a7d-b3d7-4b22-8adb-50167342384c req-228867ab-dbf1-443a-ac5f-23e5643f7658 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:01.676858 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-eb535a7d-b3d7-4b22-8adb-50167342384c req-228867ab-dbf1-443a-ac5f-23e5643f7658 service nova] Creating event network-vif-deleted:54b0fdff-ba0f-40f7-a5d6-85446cb77fb1 for instance cdb96fee-b681-4447-9387-403787cc34d5 on hv-cinder-80295 Aug 05 14:38:01.681873 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-eb535a7d-b3d7-4b22-8adb-50167342384c req-228867ab-dbf1-443a-ac5f-23e5643f7658 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030726 Aug 05 14:38:01.682460 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 493/958] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:01.690331 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:01.690967 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:01.697613 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:01.698104 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:01.698539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:01.699230 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:01.699722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:01.700150 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:01.766233 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:01.773849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ed33163b-5afd-4743-85fc-1e3975c5356d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 200 len: 1461 microversion: 2.1 time: 0.088374 Aug 05 14:38:01.774420 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 466/959] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:01 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:01.942758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "071eed1e-d685-4aa7-bee9-7325123ea1e4"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:01.945230 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:01.951546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:01.951546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:01.952260 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:01.952973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:01.953432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:01.953855 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:02.796842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:02.797436 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: cdb96fee-b681-4447-9387-403787cc34d5] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:02.803852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:02.804325 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:02.804786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:02.805475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:02.805927 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:02.806347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:02.820281 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] HTTP exception thrown: Instance cdb96fee-b681-4447-9387-403787cc34d5 could not be found. Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Request method failure captured: Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 HTTP/1.1 Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Ss0ZhieRgFTspVMDOzIayBNCuXS49iF9_HySggjDVmE0X_GSvuUem8__QjY7JoWrsYcOynpbGStSNITWCni0GE8W3dQsgiMSXLCinpqDLGNZUvMNkB3GoRWiPJtnjcKS_9Esf_zr4rZpqF4XCodxDqW6yQ3mSmX7PCfErG4xvy_Y0Q Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 58c88a9de1de4e2b83bb8a37142608a6 Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesActionsTest-760730424 Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:38:02.821941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_58c88a9de1de4e2b83bb8a37142608a6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58c88a9de1de4e2b83bb8a37142608a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/58c88a9de1de4e2b83bb8a37142608a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58c88a9de1de4e2b83bb8a37142608a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesActionsTest-760730424 Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 58c88a9de1de4e2b83bb8a37142608a6 Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesActionsTest-760730424 Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesActionsTest-760730424-project Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 4552c0df2a3f4f30b6b2829de3a8284d Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesActionsTest-760730424-project Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance cdb96fee-b681-4447-9387-403787cc34d5 could not be found. Aug 05 14:38:02.826719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'cdb96fee-b681-4447-9387-403787cc34d5'} Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb96fee-b681-4447-9387-403787cc34d5 could not be found. Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:38:02.828095 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb96fee-b681-4447-9387-403787cc34d5 could not be found. Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb96fee-b681-4447-9387-403787cc34d5 could not be found. Aug 05 14:38:02.829465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:02.830648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Returning 404 to user: Instance cdb96fee-b681-4447-9387-403787cc34d5 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:38:02.830648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c803e0de-2415-4e3e-a381-da652341f63a tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5" status: 404 len: 111 microversion: 2.1 time: 0.030650 Aug 05 14:38:02.830648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 467/960] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:02 2022] GET /compute/v2.1/servers/cdb96fee-b681-4447-9387-403787cc34d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:38:02.847796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-97f7b8d3-6d87-473b-bb2e-f9e01185c813 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909141 Aug 05 14:38:02.848848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 494/961] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:38:01 2022] POST /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:02.940876 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1767779522", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "networks": [{"uuid": "368e4eb1-4106-43a2-b8e8-506787184733"}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:02.999238 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] validate_networks() for [('368e4eb1-4106-43a2-b8e8-506787184733', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:38:03.577338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:38:03.577762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:38:03.578223 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:38:03.578621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:38:03.579020 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:38:03.587964 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:03.588532 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:03.588961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:03.589710 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:03.590162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:03.590597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:03.608441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Getting quotas for project 58c88a9de1de4e2b83bb8a37142608a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:38:03.612384 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Getting quotas for user 4552c0df2a3f4f30b6b2829de3a8284d and project 58c88a9de1de4e2b83bb8a37142608a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:38:03.624724 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:38:03.627240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:38:03.743948 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d1247d2e-44a2-4c90-8aed-4acb60856b75 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807011 Aug 05 14:38:03.745130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 468/962] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:38:03.758106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-955985b6-be78-4507-9cd5-5d2914d99256 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:03.758907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-955985b6-be78-4507-9cd5-5d2914d99256 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:03.812387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-955985b6-be78-4507-9cd5-5d2914d99256 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:03.820024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-955985b6-be78-4507-9cd5-5d2914d99256 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1214 microversion: 2.1 time: 0.066727 Aug 05 14:38:03.820649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 495/963] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:03 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:04.847925 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:04.848541 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:04.855825 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:04.856333 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:04.856794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:04.857559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:04.858639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:04.859219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:04.920456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:04.928235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5ab3cfe4-5e10-4d72-bb6d-8c3c7b795690 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1218 microversion: 2.1 time: 0.084358 Aug 05 14:38:04.928827 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 469/964] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:04 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:05.948914 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:05.949586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:05.957853 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:05.958347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:05.959763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:05.959763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:05.959976 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:05.960339 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:06.023193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:06.031476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9d986eed-97aa-4f8a-9079-9dcafdd67aee tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1284 microversion: 2.1 time: 0.086276 Aug 05 14:38:06.031905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 496/965] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:05 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:07.055330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:07.058752 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:07.065977 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:07.066484 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:07.066914 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:07.067618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:07.068077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:07.068648 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:07.208272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:07.215640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-17995b36-e32a-4934-8d5d-1fa3a8fc27e1 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.164424 Aug 05 14:38:07.216200 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 470/966] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:07 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:07.252632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-6d3c9135-bd6e-4257-b948-2ac706ca0f07 req-926bdd27-65c2-45f4-9b75-a617dd0bfad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d92595-4c10-435a-8517-99b057039a95", "tag": "db8135fd-b152-41df-873d-53a9041d6e02"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:07.262581 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-6d3c9135-bd6e-4257-b948-2ac706ca0f07 req-926bdd27-65c2-45f4-9b75-a617dd0bfad9 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:07.263126 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-6d3c9135-bd6e-4257-b948-2ac706ca0f07 req-926bdd27-65c2-45f4-9b75-a617dd0bfad9 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:07.266319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-6d3c9135-bd6e-4257-b948-2ac706ca0f07 req-926bdd27-65c2-45f4-9b75-a617dd0bfad9 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:07.274790 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-6d3c9135-bd6e-4257-b948-2ac706ca0f07 req-926bdd27-65c2-45f4-9b75-a617dd0bfad9 service nova] Creating event network-changed:db8135fd-b152-41df-873d-53a9041d6e02 for instance 29d92595-4c10-435a-8517-99b057039a95 on hv-cinder-80295 Aug 05 14:38:07.280379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-6d3c9135-bd6e-4257-b948-2ac706ca0f07 req-926bdd27-65c2-45f4-9b75-a617dd0bfad9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031004 Aug 05 14:38:07.281108 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 497/967] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:38:08.237883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:08.238494 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:08.244898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:08.245322 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:08.245755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:08.246441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:08.246888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:08.247310 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:08.378209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:08.385626 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c34f639e-1d79-460e-826d-a9ca9c6b981d tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.151593 Aug 05 14:38:08.386191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 471/968] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:08 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:08.416174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-970375670"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:08.416833 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:08.423652 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:08.424132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:08.424608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:08.425308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:08.425767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:08.426193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:08.556180 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.network.security_group_api [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Removing security group de7f5dcc-a4a1-41fa-aa08-5bc79a5f5c88 from port 2e954f61-c429-464f-983d-14b39304d5d6 Aug 05 14:38:08.891852 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-97587321-4056-47e9-9ea2-495a46b472b6 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/action" status: 202 len: 0 microversion: 2.1 time: 0.480472 Aug 05 14:38:08.892520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 498/969] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Aug 5 14:38:08 2022] POST /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:38:08.901068 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-2df62290-cf1b-4a62-adae-fa5739e3d385 req-8cd2299d-96e8-4fb7-b132-21074e064671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:08.911853 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-2df62290-cf1b-4a62-adae-fa5739e3d385 req-8cd2299d-96e8-4fb7-b132-21074e064671 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:08.911853 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-2df62290-cf1b-4a62-adae-fa5739e3d385 req-8cd2299d-96e8-4fb7-b132-21074e064671 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:08.912585 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-2df62290-cf1b-4a62-adae-fa5739e3d385 req-8cd2299d-96e8-4fb7-b132-21074e064671 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:08.923984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-2df62290-cf1b-4a62-adae-fa5739e3d385 req-8cd2299d-96e8-4fb7-b132-21074e064671 service nova] Creating event network-changed:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:38:08.930615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-2df62290-cf1b-4a62-adae-fa5739e3d385 req-8cd2299d-96e8-4fb7-b132-21074e064671 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Aug 05 14:38:08.931622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 472/970] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:09.406127 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:09.406754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:09.412796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:09.413278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:09.413710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:09.414403 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:09.414859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:09.415281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:09.591258 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:09.599395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6ae87f86-638e-4efd-b8e4-3ac8eb7be497 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.197785 Aug 05 14:38:09.599960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 499/971] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:09 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:10.150253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:10.150956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:10.157535 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.158088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.163035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.163035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.163035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.163035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.244886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lazy-loading 'services' on Instance uuid 99e8f808-494d-4076-b5ab-4bde5ccb87ce {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:38:10.249106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:10.477708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-539b2011-f128-4f4b-ac82-48b47d27c094 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments/35557781-9b44-4c7a-99b7-580a1bed6afb" status: 202 len: 0 microversion: 2.1 time: 0.332122 Aug 05 14:38:10.478305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 473/972] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:38:10 2022] DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments/35557781-9b44-4c7a-99b7-580a1bed6afb => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:38:10.486699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:10.489010 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:10.495717 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.496223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.496676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.497389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.497850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.498281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.528785 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1d21844e-268d-413c-8881-d1d7bb6c746c tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Aug 05 14:38:10.529561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 500/973] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:38:10 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:10.622005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:10.622741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:10.629078 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.629577 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.630077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.630781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.631241 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.631665 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.774171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:10.782224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d20f8f6e-f9a6-4220-86ee-1ceedc389777 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.164455 Aug 05 14:38:10.782722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 474/974] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:10 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:10.947517 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-ef482e76-40a4-42fc-adfb-06866b01101c req-0ba4bb5c-73e5-443d-97a7-044f5da97345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:10.958453 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-ef482e76-40a4-42fc-adfb-06866b01101c req-0ba4bb5c-73e5-443d-97a7-044f5da97345 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:10.959549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-ef482e76-40a4-42fc-adfb-06866b01101c req-0ba4bb5c-73e5-443d-97a7-044f5da97345 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:10.960152 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-ef482e76-40a4-42fc-adfb-06866b01101c req-0ba4bb5c-73e5-443d-97a7-044f5da97345 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:10.980050 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-ef482e76-40a4-42fc-adfb-06866b01101c req-0ba4bb5c-73e5-443d-97a7-044f5da97345 service nova] Creating event network-changed:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:38:10.981804 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-ef482e76-40a4-42fc-adfb-06866b01101c req-0ba4bb5c-73e5-443d-97a7-044f5da97345 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039157 Aug 05 14:38:10.982418 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 501/975] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:11.542047 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:11.544540 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:11.551181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:11.551660 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:11.552098 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:11.552818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:11.553276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:11.553697 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:11.583854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f50d4c6d-80cd-4bc7-b17f-f5767045da0e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 Aug 05 14:38:11.584618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 475/976] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:38:11 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:11.802434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:11.803165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:11.809773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:11.810254 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:11.810685 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:11.811971 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:11.812576 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:11.812979 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:11.953985 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:11.961581 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c86cb115-3299-4d04-b1d1-58c075d25f62 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.163341 Aug 05 14:38:11.962149 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 502/977] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:11 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:12.537077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bf3c3d59-2082-4739-bb69-4ffa9710a9a6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: .version_select at 0x7fa75d9eeca0>, body: {"keypair": {"name": "tempest-keypair-615557654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsnfxDLWNKiIHMMctomJDApCJju3/+6WuG+6V2ChjCwDsH9O/Js/M52ajsRKSNMEA9EJy+qpEhirxtCxVDdEO4Ns+SwA7+GVDQTnA/dY6n9LNf36GrFfPk2TMRArdH3xw=="}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:12.553414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-bf3c3d59-2082-4739-bb69-4ffa9710a9a6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:38:12.557410 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-bf3c3d59-2082-4739-bb69-4ffa9710a9a6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:38:12.569997 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf3c3d59-2082-4739-bb69-4ffa9710a9a6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [c438e709-1cd4-4e87-ab03-8fa6a00f97c6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 14:38:12.596171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:12.598346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:12.605082 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:12.605575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:12.606014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:12.606893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:12.607483 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:12.608493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:12.630632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:12.645188 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-088ea516-e7e6-47a9-aac4-fefddc122a0b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053446 Aug 05 14:38:12.645778 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 503/978] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:38:12 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:38:12.983150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:12.984007 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:12.991105 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:12.991591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:12.992032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:12.992764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:12.993222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:12.993651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:13.125132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:13.132546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-12e1c4f3-6fd6-4756-9adc-8a1cbf70ef58 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.153406 Aug 05 14:38:13.133218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 504/979] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:12 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:13.576389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf3c3d59-2082-4739-bb69-4ffa9710a9a6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [c438e709-1cd4-4e87-ab03-8fa6a00f97c6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45824. Aug 05 14:38:13.583237 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:13.598946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:13.649107 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bf3c3d59-2082-4739-bb69-4ffa9710a9a6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116094 Aug 05 14:38:13.649703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 476/980] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:38:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:38:13.666506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:13.666506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:13.666506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:13.666506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:13.667085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:13.667431 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:13.667883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:13.668319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:13.697899 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3dbb280c-c25f-4f2e-885e-63cd4a74cf12 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044292 Aug 05 14:38:13.698498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 505/981] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:38:13 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:38:13.709887 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:13.710385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:13.717357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:13.717847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:13.719216 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:13.720047 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:13.720569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:13.721002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:13.794662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] HTTP exception thrown: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce is not attached to volume 35557781-9b44-4c7a-99b7-580a1bed6afb Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Request method failure captured: Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments/35557781-9b44-4c7a-99b7-580a1bed6afb HTTP/1.1 Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7SpuGDVuOJuRDhGSbjOPGhDaJ7SgH4-LBeNosH9u3d9Qzjqo0w3A3r72tdbzyXCwJv2vOW7RWn1lbU04actW34Ju5CGYuvQkYXBhbBfjrK0ih3cOINOijaoqMD9sg0Iiq8MDAJizl7ZaSXIHHOwWQrm8_J0PBhvPh0U2ccpuYqGQRxw Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: ca094dd6e4d64383b75640f040744140 Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-TestMinimumBasicScenario-1484085343 Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:38:13.797991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ca094dd6e4d64383b75640f040744140", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca094dd6e4d64383b75640f040744140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ca094dd6e4d64383b75640f040744140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca094dd6e4d64383b75640f040744140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-TestMinimumBasicScenario-1484085343 Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: ca094dd6e4d64383b75640f040744140 Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1484085343 Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-TestMinimumBasicScenario-1484085343-project Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 7d37124881084b16a73f5eed20c70940 Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-TestMinimumBasicScenario-1484085343-project Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:38:13.799616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce is not attached to volume 35557781-9b44-4c7a-99b7-580a1bed6afb Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'server_id': '99e8f808-494d-4076-b5ab-4bde5ccb87ce', 'id': '35557781-9b44-4c7a-99b7-580a1bed6afb'} Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35557781-9b44-4c7a-99b7-580a1bed6afb. Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:38:13.800542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce is not attached to volume 35557781-9b44-4c7a-99b7-580a1bed6afb Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce is not attached to volume 35557781-9b44-4c7a-99b7-580a1bed6afb Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:13.802869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Returning 404 to user: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce is not attached to volume 35557781-9b44-4c7a-99b7-580a1bed6afb {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:38:13.804235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e502beec-4185-4ba9-b94a-bcbb8254857e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments/35557781-9b44-4c7a-99b7-580a1bed6afb" status: 404 len: 154 microversion: 2.1 time: 0.094022 Aug 05 14:38:13.804235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 477/982] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:38:13 2022] DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce/os-volume_attachments/35557781-9b44-4c7a-99b7-580a1bed6afb => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:38:14.154757 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:14.155557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:14.158355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:14.159496 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=51 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:14.164477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:14.164965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:14.165445 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:14.166141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:14.166754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:14.167181 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:14.302459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:14.310317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-c3ec0ac2-d404-4fca-9529-6182c4737fc0 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.159919 Aug 05 14:38:14.310903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 506/983] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:14 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:14.543503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-25ef1b98-7ee2-4be9-bf8b-6349e8ff303f req-82b188ca-6578-4c2e-99e7-aa2e1b4cd9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d92595-4c10-435a-8517-99b057039a95", "name": "network-vif-plugged", "status": "completed", "tag": "db8135fd-b152-41df-873d-53a9041d6e02"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:14.555717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-25ef1b98-7ee2-4be9-bf8b-6349e8ff303f req-82b188ca-6578-4c2e-99e7-aa2e1b4cd9c4 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:14.555717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-25ef1b98-7ee2-4be9-bf8b-6349e8ff303f req-82b188ca-6578-4c2e-99e7-aa2e1b4cd9c4 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:14.556018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-25ef1b98-7ee2-4be9-bf8b-6349e8ff303f req-82b188ca-6578-4c2e-99e7-aa2e1b4cd9c4 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:14.568610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-25ef1b98-7ee2-4be9-bf8b-6349e8ff303f req-82b188ca-6578-4c2e-99e7-aa2e1b4cd9c4 service nova] Creating event network-vif-plugged:db8135fd-b152-41df-873d-53a9041d6e02 for instance 29d92595-4c10-435a-8517-99b057039a95 on hv-cinder-80295 Aug 05 14:38:14.574067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-25ef1b98-7ee2-4be9-bf8b-6349e8ff303f req-82b188ca-6578-4c2e-99e7-aa2e1b4cd9c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034470 Aug 05 14:38:14.582148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 478/984] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:15.083532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:15.084036 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:15.090545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:15.091031 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:15.091466 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:15.092207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:15.092713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:15.093721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:15.118721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:38:15.331395 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:15.332105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:15.338357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:15.338845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:15.339289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:15.339977 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:15.340461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:15.342619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:15.433075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-13e1593f-47a2-4fe7-80eb-86de2a76444b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 204 len: 0 microversion: 2.1 time: 0.354481 Aug 05 14:38:15.434313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 507/985] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:38:15 2022] DELETE /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:38:15.450746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:15.452046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:15.462400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:15.463285 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:15.464085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:15.465378 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:15.466224 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:15.467226 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:15.475290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:15.494934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b10842e8-baf0-49dd-ae17-41600ce4a215 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.167437 Aug 05 14:38:15.495880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 479/986] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:15 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:15.647634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:15.655200 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-aed1a835-b9b6-4c6f-904f-22ced03e8b80 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1553 microversion: 2.1 time: 0.213175 Aug 05 14:38:15.658087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 508/987] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:15 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:16.222779 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1215853524", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9d713f-ec54-40f7-9839-9e1dddc5814f"}], "security_groups": [{"name": "tempest-securitygroup--2105261071"}], "key_name": "tempest-keypair-615557654", "user_data": "}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:16.324848 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] validate_networks() for [('bb9d713f-ec54-40f7-9839-9e1dddc5814f', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:38:16.519150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:16.520331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:16.528542 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:16.529032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:16.529592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:16.530295 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:16.530747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:16.531200 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:16.738789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:16.746313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-099a2995-be94-4142-a045-527cbd150e87 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.231818 Aug 05 14:38:16.746917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 509/988] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:16 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:16.759893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:16.759893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:16.764881 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:16.765402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:16.765881 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:16.766616 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:16.767075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:16.767500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:16.770453 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:38:16.770888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:38:16.771430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:38:16.771951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:38:16.772502 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:38:16.781179 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:16.781656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:16.782089 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:16.782810 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:16.783262 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:16.783684 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:16.800782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:38:16.804786 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:38:16.817014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:38:16.819273 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:38:16.895615 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:16.903068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-106a2e95-7603-4987-92d6-8df6f0bf411b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1553 microversion: 2.1 time: 0.148501 Aug 05 14:38:16.903632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 510/989] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:16 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:16.964097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ea24f695-0cf0-4a07-a193-00047216c1ff tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746374 Aug 05 14:38:16.964781 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 480/990] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:38:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:38:16.975896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-eb2f2ad7-276d-4a43-a374-fa3b1196fc41 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:16.976589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-eb2f2ad7-276d-4a43-a374-fa3b1196fc41 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:17.029324 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-eb2f2ad7-276d-4a43-a374-fa3b1196fc41 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:17.036601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-eb2f2ad7-276d-4a43-a374-fa3b1196fc41 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1241 microversion: 2.1 time: 0.064555 Aug 05 14:38:17.037179 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 511/991] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:16 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:17.768328 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:17.769080 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:17.776002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:17.776615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:17.777056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:17.777755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:17.778209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:17.778631 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:17.918564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:17.924463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:17.925083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:17.926196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-09431c13-763c-4ca5-9f85-80fc1715107c tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1314 microversion: 2.1 time: 0.162852 Aug 05 14:38:17.926765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 481/992] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:17 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:17.940823 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:17.941328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:17.941774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:17.942514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:17.943080 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:17.943601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:18.057146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:18.057747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:18.064891 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:18.065369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:18.065800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:18.066486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:18.066934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:18.067359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:18.074503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:18.082911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d3e81365-5f06-4069-8aef-764102e766d9 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1553 microversion: 2.1 time: 0.162616 Aug 05 14:38:18.086326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 512/993] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:17 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:18.128029 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:18.135374 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c95a1ad6-b03c-496c-a619-35b9f37bab90 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1245 microversion: 2.1 time: 0.082089 Aug 05 14:38:18.135930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 482/994] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:18 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:18.947562 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:18.948477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:18.955322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:18.955888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:18.956400 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:18.957196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:18.957726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:18.958228 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:19.093380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:19.102279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e8f69cca-92b3-47fe-ab7d-5551d4d68725 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1499 microversion: 2.1 time: 0.158587 Aug 05 14:38:19.103765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 513/995] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:18 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:19.105646 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:19.109388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:19.113131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:19.113720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:19.114411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:19.115344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:19.116024 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:19.116586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:19.159108 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:19.159726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:19.182045 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:19.189297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:19.189297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:19.189297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:19.189297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:19.189928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:19.198621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:19.209275 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a225d44b-4962-4c49-9646-c03cad7af137 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1511 microversion: 2.1 time: 0.107999 Aug 05 14:38:19.210197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 483/996] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:19 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:19.222357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-e1da9983-846e-4552-a414-5d1995f1eb95 req-c60410a9-c07e-4099-a143-62533459e94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e8f808-494d-4076-b5ab-4bde5ccb87ce", "name": "network-vif-deleted", "tag": "2e954f61-c429-464f-983d-14b39304d5d6"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:19.231961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e1da9983-846e-4552-a414-5d1995f1eb95 req-c60410a9-c07e-4099-a143-62533459e94c service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:19.232461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e1da9983-846e-4552-a414-5d1995f1eb95 req-c60410a9-c07e-4099-a143-62533459e94c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:19.232883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-e1da9983-846e-4552-a414-5d1995f1eb95 req-c60410a9-c07e-4099-a143-62533459e94c service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:19.246633 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-e1da9983-846e-4552-a414-5d1995f1eb95 req-c60410a9-c07e-4099-a143-62533459e94c service nova] Creating event network-vif-deleted:2e954f61-c429-464f-983d-14b39304d5d6 for instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce on hv-cinder-80295 Aug 05 14:38:19.252128 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-e1da9983-846e-4552-a414-5d1995f1eb95 req-c60410a9-c07e-4099-a143-62533459e94c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Aug 05 14:38:19.252841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 484/997] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:38:19.267218 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:19.274838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4d1ece30-e3bc-4753-b5b4-b5737714ab8e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1293 microversion: 2.1 time: 0.121385 Aug 05 14:38:19.275398 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 514/998] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:19 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:19.996274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:19.996893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:20.004681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.005197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.005635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.006340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.006883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.007217 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.036017 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:38:20.231210 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:20.231885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:20.238421 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.238907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.239344 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.240373 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.240647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.241085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.273762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.274289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.274710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.275294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lazy-loading 'fault' on Instance uuid 99e8f808-494d-4076-b5ab-4bde5ccb87ce {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:38:20.323134 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d37124881084b16a73f5eed20c70940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca094dd6e4d64383b75640f040744140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:20.332754 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-80cfbfaf-4eaa-4c0c-9719-b0bcefd27c9b tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 200 len: 1348 microversion: 2.1 time: 0.105317 Aug 05 14:38:20.333333 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 515/999] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:20 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:20.338393 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:20.339203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:20.347958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.348767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.349281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.350062 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.350613 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.351120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.377531 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4cf766c9-41d0-4897-8807-ee97de44a3aa tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "DELETE /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 204 len: 0 microversion: 2.1 time: 0.385307 Aug 05 14:38:20.378788 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 485/1000] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:38:19 2022] DELETE /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:38:20.387558 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:20.388549 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:20.395793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.396276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.396933 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.399870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:20.400340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:20.400803 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:20.420146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:20.428371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-29a24cb3-5dbc-415e-85e1-575de8237a34 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1299 microversion: 2.1 time: 0.093625 Aug 05 14:38:20.429055 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 516/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:20 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:20.541934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:20.550227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-40f9ef96-d2b6-4526-b9c1-ae46d1fe4df4 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1505 microversion: 2.1 time: 0.166791 Aug 05 14:38:20.550798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 486/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:20 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:21.355371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:21.355927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] [instance: 99e8f808-494d-4076-b5ab-4bde5ccb87ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:21.363253 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:21.363732 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:21.364167 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:21.364875 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:21.365329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:21.365748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:21.380062 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] HTTP exception thrown: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce could not be found. Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Request method failure captured: Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce HTTP/1.1 Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7SpuGDVuOJuRDhGSbjOPGhDaJ7SgH4-LBeNosH9u3d9Qzjqo0w3A3r72tdbzyXCwJv2vOW7RWn1lbU04actW34Ju5CGYuvQkYXBhbBfjrK0ih3cOINOijaoqMD9sg0Iiq8MDAJizl7ZaSXIHHOwWQrm8_J0PBhvPh0U2ccpuYqGQRxw Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: ca094dd6e4d64383b75640f040744140 Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-TestMinimumBasicScenario-1484085343 Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:38:21.381715 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ca094dd6e4d64383b75640f040744140", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca094dd6e4d64383b75640f040744140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ca094dd6e4d64383b75640f040744140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca094dd6e4d64383b75640f040744140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-TestMinimumBasicScenario-1484085343 Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: ca094dd6e4d64383b75640f040744140 Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1484085343 Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-TestMinimumBasicScenario-1484085343-project Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 7d37124881084b16a73f5eed20c70940 Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-TestMinimumBasicScenario-1484085343-project Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce could not be found. Aug 05 14:38:21.383294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '99e8f808-494d-4076-b5ab-4bde5ccb87ce'} Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce could not be found. Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:38:21.384288 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce could not be found. Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce could not be found. Aug 05 14:38:21.385807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:38:21.387312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Returning 404 to user: Instance 99e8f808-494d-4076-b5ab-4bde5ccb87ce could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:38:21.387312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-23b74f45-b477-4baa-987a-0dd9ef75343e tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce" status: 404 len: 111 microversion: 2.1 time: 0.031844 Aug 05 14:38:21.387312 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 517/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:21 2022] GET /compute/v2.1/servers/99e8f808-494d-4076-b5ab-4bde5ccb87ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:38:21.392252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3ffa98e7-ef3c-471b-ab9d-e70bc135c245 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] Calling method '.version_select at 0x7fa75e248040>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:21.457398 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:21.458036 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:21.463958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:21.464462 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:21.464898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:21.465585 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:21.466040 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:21.466389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3ffa98e7-ef3c-471b-ab9d-e70bc135c245 tempest-TestMinimumBasicScenario-1484085343 tempest-TestMinimumBasicScenario-1484085343-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-246779284" status: 202 len: 0 microversion: 2.1 time: 0.078426 Aug 05 14:38:21.466497 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:21.467197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 487/1004] 10.222.0.26 () {58 vars in 1269 bytes} [Fri Aug 5 14:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-246779284 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:38:21.572329 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:21.573556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:21.580595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:21.581401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:21.582320 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:21.583842 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:21.584335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:21.584888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:21.636996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:21.647134 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-155b80db-4436-4fa9-b467-2b0af9e44611 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.193294 Aug 05 14:38:21.653140 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 518/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:21 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:21.739260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:21.747018 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-87c6ac11-86cb-4aaa-aba7-3105588f5606 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1505 microversion: 2.1 time: 0.178971 Aug 05 14:38:21.747607 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 488/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:21 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:22.245946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-094712a6-e30f-4596-b8fd-d26bbce2564d req-2d6283c3-d042-4093-9098-eeab2aaae40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91bec62-a7dd-401a-8017-b9a97847c352", "tag": "1525d3b5-e2fd-4bc2-8099-76c599537e3e"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:22.259337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-094712a6-e30f-4596-b8fd-d26bbce2564d req-2d6283c3-d042-4093-9098-eeab2aaae40a service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:22.259811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-094712a6-e30f-4596-b8fd-d26bbce2564d req-2d6283c3-d042-4093-9098-eeab2aaae40a service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:22.260239 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-094712a6-e30f-4596-b8fd-d26bbce2564d req-2d6283c3-d042-4093-9098-eeab2aaae40a service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:22.273591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-094712a6-e30f-4596-b8fd-d26bbce2564d req-2d6283c3-d042-4093-9098-eeab2aaae40a service nova] Creating event network-changed:1525d3b5-e2fd-4bc2-8099-76c599537e3e for instance c91bec62-a7dd-401a-8017-b9a97847c352 on hv-cinder-80295 Aug 05 14:38:22.278707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-094712a6-e30f-4596-b8fd-d26bbce2564d req-2d6283c3-d042-4093-9098-eeab2aaae40a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 Aug 05 14:38:22.279303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 519/1007] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:22.669517 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:22.670152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:22.679024 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:22.679590 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:22.680032 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:22.680774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:22.681327 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:22.681751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:22.769965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:22.771447 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:22.778446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:22.778940 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:22.779446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:22.780138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:22.781392 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:22.782046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:22.801993 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:22.838429 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:22.848079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6b748415-ee75-490a-b5c4-3df2fa1658d8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.182402 Aug 05 14:38:22.860079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 489/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:22 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:22.946511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:22.954952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3fb077cf-ce7e-41e8-bb49-a7def4f18856 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1505 microversion: 2.1 time: 0.190456 Aug 05 14:38:22.958014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 520/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:22 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:23.870789 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:23.872143 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:23.879668 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:23.880234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:23.880892 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:23.881618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:23.882069 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:23.882512 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:23.977262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:23.977876 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:23.985091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:23.985574 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:23.986201 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:23.986900 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:23.987357 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:23.987784 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:24.021676 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:24.022174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:24.022622 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:24.023071 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lazy-loading 'fault' on Instance uuid 29d92595-4c10-435a-8517-99b057039a95 {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:38:24.108272 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:24.115704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-140ef190-fe60-4df4-80c3-eca185da4b36 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1304 microversion: 2.1 time: 0.142379 Aug 05 14:38:24.116383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 521/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:23 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:24.137462 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:24.145507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-355686e4-60ef-4fe5-bfaa-337e778cb72b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.278760 Aug 05 14:38:24.146059 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 490/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:23 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:24.297265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-191f529c-7c99-407a-96a0-4cba376f8dbb req-9033d69e-545b-44f3-9bf2-cc1f4acf6144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d92595-4c10-435a-8517-99b057039a95", "name": "network-vif-deleted", "tag": "db8135fd-b152-41df-873d-53a9041d6e02"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:24.308172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-191f529c-7c99-407a-96a0-4cba376f8dbb req-9033d69e-545b-44f3-9bf2-cc1f4acf6144 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:24.308781 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-191f529c-7c99-407a-96a0-4cba376f8dbb req-9033d69e-545b-44f3-9bf2-cc1f4acf6144 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:24.309237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-191f529c-7c99-407a-96a0-4cba376f8dbb req-9033d69e-545b-44f3-9bf2-cc1f4acf6144 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:24.322310 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-191f529c-7c99-407a-96a0-4cba376f8dbb req-9033d69e-545b-44f3-9bf2-cc1f4acf6144 service nova] Creating event network-vif-deleted:db8135fd-b152-41df-873d-53a9041d6e02 for instance 29d92595-4c10-435a-8517-99b057039a95 on hv-cinder-80295 Aug 05 14:38:24.327271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-191f529c-7c99-407a-96a0-4cba376f8dbb req-9033d69e-545b-44f3-9bf2-cc1f4acf6144 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033850 Aug 05 14:38:24.328793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 522/1012] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:25.137182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:25.137798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:25.144256 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:25.144776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:25.145296 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:25.145909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:25.146541 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:25.147149 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:25.167207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:25.168945 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:25.178484 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:25.178977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:25.179412 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:25.182148 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:25.182148 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:25.182530 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:25.203640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:25.204368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:25.205010 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:25.205617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lazy-loading 'fault' on Instance uuid 29d92595-4c10-435a-8517-99b057039a95 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:38:25.310896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552c0df2a3f4f30b6b2829de3a8284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c88a9de1de4e2b83bb8a37142608a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:25.319169 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b9b1bf74-17e4-4f15-b0e7-1fdca47266e2 tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 200 len: 1304 microversion: 2.1 time: 0.185887 Aug 05 14:38:25.319741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 491/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:25 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:25.428788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:25.436541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-34c0ccda-c66a-4e95-9350-37a5a1c35b72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.273956 Aug 05 14:38:25.437119 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 523/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:25 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:38:26.340355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:26.341257 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] [instance: 29d92595-4c10-435a-8517-99b057039a95] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:26.350350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:26.351122 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:26.351558 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:26.353347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:26.353806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:26.354398 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:26.359999 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:26.378097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] HTTP exception thrown: Instance 29d92595-4c10-435a-8517-99b057039a95 could not be found. Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Request method failure captured: Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 HTTP/1.1 Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Ss0ZhieRgFTspVMDOzIayBNCuXS49iF9_HySggjDVmE0X_GSvuUem8__QjY7JoWrsYcOynpbGStSNITWCni0GE8W3dQsgiMSXLCinpqDLGNZUvMNkB3GoRWiPJtnjcKS_9Esf_zr4rZpqF4XCodxDqW6yQ3mSmX7PCfErG4xvy_Y0Q Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: 58c88a9de1de4e2b83bb8a37142608a6 Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-VolumesActionsTest-760730424 Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:38:26.379755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_58c88a9de1de4e2b83bb8a37142608a6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58c88a9de1de4e2b83bb8a37142608a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/58c88a9de1de4e2b83bb8a37142608a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58c88a9de1de4e2b83bb8a37142608a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-VolumesActionsTest-760730424 Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: 58c88a9de1de4e2b83bb8a37142608a6 Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-VolumesActionsTest-760730424 Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-VolumesActionsTest-760730424-project Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 4552c0df2a3f4f30b6b2829de3a8284d Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-VolumesActionsTest-760730424-project Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 29d92595-4c10-435a-8517-99b057039a95 could not be found. Aug 05 14:38:26.381196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '29d92595-4c10-435a-8517-99b057039a95'} Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d92595-4c10-435a-8517-99b057039a95 could not be found. Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:38:26.381936 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d92595-4c10-435a-8517-99b057039a95 could not be found. Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d92595-4c10-435a-8517-99b057039a95 could not be found. Aug 05 14:38:26.383481 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:38:26.385636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] Returning 404 to user: Instance 29d92595-4c10-435a-8517-99b057039a95 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:38:26.386636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9dad96fa-2a05-4464-8aaf-d71357c01cad tempest-VolumesActionsTest-760730424 tempest-VolumesActionsTest-760730424-project] 10.222.0.26 "GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95" status: 404 len: 111 microversion: 2.1 time: 0.051348 Aug 05 14:38:26.387361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 492/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:26 2022] GET /compute/v2.1/servers/29d92595-4c10-435a-8517-99b057039a95 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:38:26.459149 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:26.460474 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:26.467802 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:26.469297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:26.469737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:26.470443 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:26.470896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:26.471314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:26.651569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:26.664155 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bad0e60e-c98c-41ef-927c-dfca98fb7d64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.209196 Aug 05 14:38:26.665500 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 524/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:26 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:27.692861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:27.693568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:27.696805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:27.696805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=16 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:27.705103 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:27.705594 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:27.706025 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:27.706722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:27.707171 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:27.707589 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:27.933658 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:27.941136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-929a33a4-1b8e-42ea-9d5e-dedee4913893 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.252262 Aug 05 14:38:27.941703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 493/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:27 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:28.961820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:28.962688 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:28.965289 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:28.972314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:28.973027 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:28.973537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:28.974326 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:28.975244 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:28.975545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:29.123896 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:29.132705 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8027f503-8e33-4eec-ab91-61c074b9edf5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.174960 Aug 05 14:38:29.133282 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 525/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:28 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:30.152687 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:30.153357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:30.160390 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:30.164038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:30.164038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:30.164038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:30.164038 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:30.164443 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:30.304173 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:30.312863 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5550dc07-7867-426a-b99a-ec1132c79c08 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.163417 Aug 05 14:38:30.313508 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 494/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:30 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:31.334314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:31.335034 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:31.341582 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:31.342066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:31.342507 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:31.343576 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:31.344154 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:31.344806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:31.480762 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:31.489521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3d8757d3-f60d-4f12-98ac-a1c1b16c36d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.159064 Aug 05 14:38:31.490093 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 526/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:31 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:31.977592 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-8cf767ae-2161-4afa-8bc9-1bcfa604b61c req-1206cc01-36ff-4757-a278-23c1bbbd6717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bec62-a7dd-401a-8017-b9a97847c352", "name": "network-vif-plugged", "status": "completed", "tag": "1525d3b5-e2fd-4bc2-8099-76c599537e3e"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:31.992226 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-8cf767ae-2161-4afa-8bc9-1bcfa604b61c req-1206cc01-36ff-4757-a278-23c1bbbd6717 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:31.992888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-8cf767ae-2161-4afa-8bc9-1bcfa604b61c req-1206cc01-36ff-4757-a278-23c1bbbd6717 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:31.993397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-8cf767ae-2161-4afa-8bc9-1bcfa604b61c req-1206cc01-36ff-4757-a278-23c1bbbd6717 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:32.007151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-8cf767ae-2161-4afa-8bc9-1bcfa604b61c req-1206cc01-36ff-4757-a278-23c1bbbd6717 service nova] Creating event network-vif-plugged:1525d3b5-e2fd-4bc2-8099-76c599537e3e for instance c91bec62-a7dd-401a-8017-b9a97847c352 on hv-cinder-80295 Aug 05 14:38:32.012879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-8cf767ae-2161-4afa-8bc9-1bcfa604b61c req-1206cc01-36ff-4757-a278-23c1bbbd6717 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041594 Aug 05 14:38:32.013568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 495/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:32.511427 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:32.512638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:32.520189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:32.520746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:32.523520 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:32.524749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:32.525211 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:32.525637 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:32.677564 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:32.685060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e91c8d5d-1415-44ae-bcf1-4890740057d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.178612 Aug 05 14:38:32.685765 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 527/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:32 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:33.711969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:33.712772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:33.725859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:33.726348 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:33.726991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:33.727696 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:33.728244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:33.728694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:33.891586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:33.900811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c38073c2-94bd-49d3-895d-f1aa7d9b0bd9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1367 microversion: 2.1 time: 0.197853 Aug 05 14:38:33.901627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 496/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:33 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:34.923842 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:34.924456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:34.931311 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:34.932198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:34.932725 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:34.933650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:34.934109 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:34.934774 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:35.106641 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:38:35.116405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9235ffd5-e8dd-4c02-bc4c-6533554431d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1557 microversion: 2.1 time: 0.196885 Aug 05 14:38:35.117056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 528/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:38:34 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1557 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:38:35.142003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:38:35.143356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:38:35.150300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:35.151042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:35.151485 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:35.152201 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:35.152995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:35.153433 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:35.265187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bbabfb6e-4378-4d29-b66d-371888686b42 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129257 Aug 05 14:38:35.272791 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 497/1025] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:38:35 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:36.446744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-bb0d06b2-8b2e-45e2-abb4-71703a3d00f7 req-a2e413a1-419f-45d8-9f5b-5e0a79161dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91bec62-a7dd-401a-8017-b9a97847c352", "tag": "1525d3b5-e2fd-4bc2-8099-76c599537e3e"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:36.457744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-bb0d06b2-8b2e-45e2-abb4-71703a3d00f7 req-a2e413a1-419f-45d8-9f5b-5e0a79161dd1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:38:36.458366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-bb0d06b2-8b2e-45e2-abb4-71703a3d00f7 req-a2e413a1-419f-45d8-9f5b-5e0a79161dd1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:38:36.458889 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-bb0d06b2-8b2e-45e2-abb4-71703a3d00f7 req-a2e413a1-419f-45d8-9f5b-5e0a79161dd1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:38:36.472518 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-bb0d06b2-8b2e-45e2-abb4-71703a3d00f7 req-a2e413a1-419f-45d8-9f5b-5e0a79161dd1 service nova] Creating event network-changed:1525d3b5-e2fd-4bc2-8099-76c599537e3e for instance c91bec62-a7dd-401a-8017-b9a97847c352 on hv-cinder-80295 Aug 05 14:38:36.477962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-bb0d06b2-8b2e-45e2-abb4-71703a3d00f7 req-a2e413a1-419f-45d8-9f5b-5e0a79161dd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035707 Aug 05 14:38:36.479147 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 529/1026] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:38:48.628524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:48.629962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=24 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:38:48.853260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4ef0f4c1-524a-4a06-ac6c-fccaa705aa9e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Action: 'create', calling method: .version_select at 0x7fa75e25ab80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-402318749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdhXOlYYpQJOVFxKMyH4BxCxQbEmoz1STX6BOxinDwxig1Uac/vYItZQqkC+tfZCILHH5rWwCBpmVPNj4mjmsRtL4+8fWAS2IYcVplK3N/js6TbRkWvYBPZqJWbDmC/SQ=="}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:38:48.877055 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-4ef0f4c1-524a-4a06-ac6c-fccaa705aa9e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for project d408cabccaa44c338d6031955d3a1f7c. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:38:48.884090 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-4ef0f4c1-524a-4a06-ac6c-fccaa705aa9e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for user f7b9ccd1b8cc4832a9c77513b5f21815 and project d408cabccaa44c338d6031955d3a1f7c. Resources: {'key_pairs'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:38:48.981148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4ef0f4c1-524a-4a06-ac6c-fccaa705aa9e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.354226 Aug 05 14:38:48.982355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 498/1027] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:38:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:38:58.412796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:38:58.413286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:39:16.051006 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:16.051751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=50 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:16.055890 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-739304471", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-402318749", "security_groups": [{"name": "tempest-secgroup-smoke-966977818"}], "block_device_mapping_v2": [{"uuid": "41e5a089-35c0-46a1-a91f-fe896904cc29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "190f2fff-2ff1-45fd-bd0d-e0bb27a89b96"}]}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:39:16.170030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.network.neutron [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] validate_networks() for [('190f2fff-2ff1-45fd-bd0d-e0bb27a89b96', None, None, None, None, None)] {{(pid=118053) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:39:16.533958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Flavor limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:39:16.534405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Image limits 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:39:16.534872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Flavor pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:39:16.535280 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Image pref 0:0:0 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:39:16.535686 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.virt.hardware [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:39:16.544467 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:16.544953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:16.545382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:16.546107 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:16.546557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:16.546975 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:16.563837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for project d408cabccaa44c338d6031955d3a1f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:39:16.567972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for user f7b9ccd1b8cc4832a9c77513b5f21815 and project d408cabccaa44c338d6031955d3a1f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:39:16.624525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Going to run 1 instances... {{(pid=118053) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:39:16.626690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41e5a089-35c0-46a1-a91f-fe896904cc29',volume_size=None,volume_type=None)] {{(pid=118053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:39:17.080597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-30b26be6-e521-4986-b565-2bbe8f49695b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031103 Aug 05 14:39:17.081401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 530/1028] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:39:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:39:17.089455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=4 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:17.092909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:17.094932 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-63030f24-5b7c-4a53-af57-bef48a8ba06b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:17.095720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-63030f24-5b7c-4a53-af57-bef48a8ba06b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:17.152583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-63030f24-5b7c-4a53-af57-bef48a8ba06b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:17.159917 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-63030f24-5b7c-4a53-af57-bef48a8ba06b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1093 microversion: 2.1 time: 0.071818 Aug 05 14:39:17.160507 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 499/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:17 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:18.180557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:18.181222 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:18.187837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:18.188319 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:18.188781 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:18.189475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:18.189936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:18.190365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:18.251946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:18.259507 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2ce2e245-7980-4f5b-bf13-30a401d5d095 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1143 microversion: 2.1 time: 0.082911 Aug 05 14:39:18.260081 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 531/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:18 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:19.282480 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:19.283094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:19.289850 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:19.290334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:19.290896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:19.291528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:19.292007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:19.292447 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:19.355811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:19.364188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-804f1dc1-be44-41c6-b6cf-1faee3f99006 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1199 microversion: 2.1 time: 0.085989 Aug 05 14:39:19.376438 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 500/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:19 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:20.386149 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:20.386901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:20.394487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:20.395087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:20.395588 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:20.396366 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:20.397030 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:20.397456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:20.534491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:20.542097 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7f870e81-dbff-4b18-8df4-2ce39e499a39 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1276 microversion: 2.1 time: 0.160202 Aug 05 14:39:20.542806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 532/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:20 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:20.807288 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-947c921b-9886-4a14-bd4b-1084c297e1f7 req-c4951cda-6845-4a13-a1f7-2c896e966a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a699c20b-23fc-40e9-ac3d-d835d5b7397c", "tag": "ebaa79c4-f517-486c-a403-bb280d2fd64d"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:39:20.818404 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-947c921b-9886-4a14-bd4b-1084c297e1f7 req-c4951cda-6845-4a13-a1f7-2c896e966a24 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:20.819198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-947c921b-9886-4a14-bd4b-1084c297e1f7 req-c4951cda-6845-4a13-a1f7-2c896e966a24 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:20.819822 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-947c921b-9886-4a14-bd4b-1084c297e1f7 req-c4951cda-6845-4a13-a1f7-2c896e966a24 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:20.834475 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-947c921b-9886-4a14-bd4b-1084c297e1f7 req-c4951cda-6845-4a13-a1f7-2c896e966a24 service nova] Creating event network-changed:ebaa79c4-f517-486c-a403-bb280d2fd64d for instance a699c20b-23fc-40e9-ac3d-d835d5b7397c on hv-cinder-80295 Aug 05 14:39:20.839428 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-947c921b-9886-4a14-bd4b-1084c297e1f7 req-c4951cda-6845-4a13-a1f7-2c896e966a24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036086 Aug 05 14:39:20.840077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 501/1033] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:39:21.563743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:21.564263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:21.570619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:21.571103 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:21.571541 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:21.572232 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:21.572721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:21.573146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:21.713094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:21.721638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-671b5320-2d99-452e-a6aa-0979028e5dcf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.162295 Aug 05 14:39:21.722238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 533/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:21 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:22.743370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:22.744099 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:22.750693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:22.751175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:22.751609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:22.752291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:22.752776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:22.753201 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:22.881408 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:22.888795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0bdbae5f-f52f-4eee-8446-b7c9c4602343 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.149623 Aug 05 14:39:22.889361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 502/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:22 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:23.910820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:23.911427 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:23.917814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:23.918292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:23.918722 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:23.919397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:23.919963 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:23.920434 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:24.052836 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:24.060382 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-26047456-7a6a-4dcd-8483-c988056d90d6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.154470 Aug 05 14:39:24.060956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 534/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:23 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:25.081655 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:25.082214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:25.088558 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:25.089035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:25.089464 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:25.090148 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:25.090615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:25.091053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:25.221276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:25.228682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9fe0e5e3-a1ec-406b-b907-96abdab5e889 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.151601 Aug 05 14:39:25.229249 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 503/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:25 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:26.248648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:26.249286 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:26.255883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:26.256359 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:26.257494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:26.258199 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:26.258656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:26.259076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:26.393161 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:26.400433 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d983287f-6928-4dae-ac10-4e3e4b56be44 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.155684 Aug 05 14:39:26.401002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 535/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:26 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:27.423084 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:27.423699 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:27.426163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:27.430913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:27.438456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:27.438456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:27.438456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:27.438456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:27.438835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:27.566945 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:27.574423 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b45bee6e-445e-47c5-9e80-c83558802609 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.155429 Aug 05 14:39:27.574990 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 504/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:27 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:28.596528 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:28.597142 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:28.598995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:28.599781 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:28.604888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:28.605377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:28.605813 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:28.606503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:28.606956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:28.607380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:28.737368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:28.744751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f110cd9a-4234-4480-9e56-db963dac67cf tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.152960 Aug 05 14:39:28.745315 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 536/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:28 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:29.765282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:29.765900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:29.772260 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:29.772777 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:29.773218 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:29.773949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:29.774406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:29.774831 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:29.907349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:29.914890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b6a3d8a1-9504-4057-aca9-7dc5776993cd tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.153572 Aug 05 14:39:29.915459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 505/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:29 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:30.935131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:30.935767 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:30.942259 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:30.942737 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:30.943166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:30.943843 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:30.944290 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:30.944753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:31.072246 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:31.080475 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2f549d36-d8f0-4ea0-a9c1-fe0cde4541b8 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.148499 Aug 05 14:39:31.081056 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 537/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:30 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:32.101371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:32.101982 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:32.108805 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:32.109214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:32.109652 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:32.110346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:32.110799 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:32.111881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:32.242276 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-91aafa31-1347-47e5-a516-b903b4ca5053 req-acd18274-5d21-4c98-97cc-ce33addf0451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a699c20b-23fc-40e9-ac3d-d835d5b7397c", "name": "network-vif-plugged", "status": "completed", "tag": "ebaa79c4-f517-486c-a403-bb280d2fd64d"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:39:32.253198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-91aafa31-1347-47e5-a516-b903b4ca5053 req-acd18274-5d21-4c98-97cc-ce33addf0451 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:32.253682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-91aafa31-1347-47e5-a516-b903b4ca5053 req-acd18274-5d21-4c98-97cc-ce33addf0451 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:32.253920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:32.254114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-91aafa31-1347-47e5-a516-b903b4ca5053 req-acd18274-5d21-4c98-97cc-ce33addf0451 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:32.261650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-f6d741f9-7c0d-4d82-8679-7314b38adf95 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.164052 Aug 05 14:39:32.262227 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 506/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:32 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:32.266310 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-91aafa31-1347-47e5-a516-b903b4ca5053 req-acd18274-5d21-4c98-97cc-ce33addf0451 service nova] Creating event network-vif-plugged:ebaa79c4-f517-486c-a403-bb280d2fd64d for instance a699c20b-23fc-40e9-ac3d-d835d5b7397c on hv-cinder-80295 Aug 05 14:39:32.272865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-91aafa31-1347-47e5-a516-b903b4ca5053 req-acd18274-5d21-4c98-97cc-ce33addf0451 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034426 Aug 05 14:39:32.273498 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 538/1044] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:39:33.283811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:33.284437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:33.290802 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:33.291289 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:33.291729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:33.292469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:33.292923 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:33.293344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:33.426081 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:33.433451 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4c65a59e-44ba-4bab-9872-4f00ef453059 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.154171 Aug 05 14:39:33.434012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 507/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:33 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:34.454589 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:34.455294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:34.463125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:34.464687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:34.464687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:34.464951 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:34.465401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:34.465864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:34.599808 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:34.607401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-62e30316-4d78-442a-a331-5244c82da9b4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1264 microversion: 2.1 time: 0.157205 Aug 05 14:39:34.613620 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 539/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:34 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:35.629419 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:35.630028 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:35.636364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:35.636946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:35.637380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:35.638069 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:35.638521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:35.638944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:35.771338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:35.779016 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1f2407e8-8448-4e9f-84ad-786adfa16c4f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1452 microversion: 2.1 time: 0.153985 Aug 05 14:39:35.779533 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 508/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:35 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:35.799901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:35.800540 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:35.806877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:35.807362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:35.807794 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:35.808503 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:35.808956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:35.809377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:35.939252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:39:35.946820 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d991c1f6-4899-4f11-a377-6fc685890c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1452 microversion: 2.1 time: 0.151377 Aug 05 14:39:35.947381 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 540/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:39:35 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:39:38.181985 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-c943111e-6a71-4ffc-800b-f0f9a53761ce req-0f58fec5-a9a0-4007-ade6-51d61fb9d337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a699c20b-23fc-40e9-ac3d-d835d5b7397c", "tag": "ebaa79c4-f517-486c-a403-bb280d2fd64d"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:39:38.192219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-c943111e-6a71-4ffc-800b-f0f9a53761ce req-0f58fec5-a9a0-4007-ade6-51d61fb9d337 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:38.192655 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-c943111e-6a71-4ffc-800b-f0f9a53761ce req-0f58fec5-a9a0-4007-ade6-51d61fb9d337 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:38.193087 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-c943111e-6a71-4ffc-800b-f0f9a53761ce req-0f58fec5-a9a0-4007-ade6-51d61fb9d337 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:38.204168 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-c943111e-6a71-4ffc-800b-f0f9a53761ce req-0f58fec5-a9a0-4007-ade6-51d61fb9d337 service nova] Creating event network-changed:ebaa79c4-f517-486c-a403-bb280d2fd64d for instance a699c20b-23fc-40e9-ac3d-d835d5b7397c on hv-cinder-80295 Aug 05 14:39:38.209852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-c943111e-6a71-4ffc-800b-f0f9a53761ce req-0f58fec5-a9a0-4007-ade6-51d61fb9d337 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031618 Aug 05 14:39:38.210457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 509/1049] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:39:59.492674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:59.493264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:59.495544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:59.496234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=58 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:59.500952 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:59.501443 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:59.501886 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:59.502638 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:59.506848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:59.506848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:59.529828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-29373642-8613-41e3-b04f-9dce5c3e1f82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/ips" status: 200 len: 149 microversion: 2.1 time: 0.038903 Aug 05 14:39:59.529828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 541/1050] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:39:59 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:39:59.537302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=24 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:59.538043 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=52 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:39:59.542246 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "071eed1e-d685-4aa7-bee9-7325123ea1e4"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:39:59.544663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:59.551224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:59.552896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:59.552896 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:59.553129 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:59.553367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:59.553792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:59.631989 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Invalid volume: volume 071eed1e-d685-4aa7-bee9-7325123ea1e4 is already attached to instances: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: POST /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/os-volume_attachments HTTP/1.1 Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 74 Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:39:59.633725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {"volumeAttachment": {"volumeId": "071eed1e-d685-4aa7-bee9-7325123ea1e4"}} Aug 05 14:39:59.635442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Invalid volume: volume 071eed1e-d685-4aa7-bee9-7325123ea1e4 is already attached to instances: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'server_id': 'c91bec62-a7dd-401a-8017-b9a97847c352', 'body': {'volumeAttachment': {'volumeId': '071eed1e-d685-4aa7-bee9-7325123ea1e4'}}} Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 071eed1e-d685-4aa7-bee9-7325123ea1e4 is already attached to instances: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:39:59.636530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 071eed1e-d685-4aa7-bee9-7325123ea1e4 is already attached to instances: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:39:59.638058 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 071eed1e-d685-4aa7-bee9-7325123ea1e4 is already attached to instances: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 400 to user: Invalid volume: volume 071eed1e-d685-4aa7-bee9-7325123ea1e4 is already attached to instances: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d8b6d70f-a4f0-4e21-ad83-509e7a2eb222 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099523 Aug 05 14:39:59.639843 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 510/1051] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:39:59 2022] POST /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 14:39:59.644252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:39:59.644782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:39:59.651444 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:59.651917 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:59.652349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:59.656297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:39:59.656297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:39:59.656297 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:39:59.679598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:40:00.002208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e5358f3c-06fb-4b07-a899-6c8aa126915c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 204 len: 0 microversion: 2.1 time: 0.361783 Aug 05 14:40:00.002793 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 542/1052] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:39:59 2022] DELETE /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 14:40:00.011253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:00.011946 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:00.018669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:00.019791 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:00.020518 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:00.021301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:00.021757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:00.022317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:00.157694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:00.165479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c20fc035-1edb-467c-9b5c-73f7ce394246 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1681 microversion: 2.1 time: 0.158234 Aug 05 14:40:00.166675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 511/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:00 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:01.186892 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:01.187740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:01.196029 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:01.196553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:01.197024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:01.197848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:01.198440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:01.198861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:01.330811 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:01.338511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9aa05a9d-8a69-46ef-8660-2d2af7640a2c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1681 microversion: 2.1 time: 0.155814 Aug 05 14:40:01.339086 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 543/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:01 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:02.359657 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:02.360276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:02.367421 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:02.367917 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:02.368355 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:02.369088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:02.369541 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:02.369959 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:02.505461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:02.512988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d423d507-f1fc-4e5d-ae37-2329e64fc639 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1681 microversion: 2.1 time: 0.157398 Aug 05 14:40:02.513559 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 512/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:02 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:02.791120 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-b8ad5e31-96ad-4d17-844d-c017f01233eb req-8f54bbeb-6211-472f-94c0-be6b3d0676f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bec62-a7dd-401a-8017-b9a97847c352", "name": "network-vif-deleted", "tag": "1525d3b5-e2fd-4bc2-8099-76c599537e3e"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:02.801233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b8ad5e31-96ad-4d17-844d-c017f01233eb req-8f54bbeb-6211-472f-94c0-be6b3d0676f1 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:02.801721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b8ad5e31-96ad-4d17-844d-c017f01233eb req-8f54bbeb-6211-472f-94c0-be6b3d0676f1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:02.802156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-b8ad5e31-96ad-4d17-844d-c017f01233eb req-8f54bbeb-6211-472f-94c0-be6b3d0676f1 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:02.813950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-b8ad5e31-96ad-4d17-844d-c017f01233eb req-8f54bbeb-6211-472f-94c0-be6b3d0676f1 service nova] Creating event network-vif-deleted:1525d3b5-e2fd-4bc2-8099-76c599537e3e for instance c91bec62-a7dd-401a-8017-b9a97847c352 on hv-cinder-80295 Aug 05 14:40:02.819610 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-b8ad5e31-96ad-4d17-844d-c017f01233eb req-8f54bbeb-6211-472f-94c0-be6b3d0676f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032073 Aug 05 14:40:02.820216 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 544/1056] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:03.538988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:03.539615 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:03.545703 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:03.548566 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:03.548566 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:03.548566 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:03.548566 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:03.548941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:03.580002 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:03.580519 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:03.580960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:03.581407 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'fault' on Instance uuid c91bec62-a7dd-401a-8017-b9a97847c352 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:40:03.625097 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:03.633627 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-200c7f58-3348-4670-be54-f40869defbfb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 200 len: 1331 microversion: 2.1 time: 0.099176 Aug 05 14:40:03.634211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 513/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:03 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:04.656153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:04.656874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:04.663789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:04.664261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:04.664792 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:04.665476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:04.665928 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:04.666350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:04.679763 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 HTTP/1.1 Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:40:04.681388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:40:04.683059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'c91bec62-a7dd-401a-8017-b9a97847c352'} Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:40:04.684076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:40:04.685704 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:04.687157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:40:04.687157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-655d2f86-116d-4211-8e0f-3344a548a5d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 404 len: 111 microversion: 2.1 time: 0.030841 Aug 05 14:40:04.687157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 545/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:04 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:40:04.691347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b48308ba-0b6d-4102-8591-aa48cede4a64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '.version_select at 0x7fa75e25f4c0>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:04.751301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b48308ba-0b6d-4102-8591-aa48cede4a64 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615557654" status: 202 len: 0 microversion: 2.1 time: 0.063624 Aug 05 14:40:04.751880 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 514/1059] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Aug 5 14:40:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615557654 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:40:05.535136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:05.536209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:05.542293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:05.542780 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:05.543206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:05.543891 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:05.544346 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:05.544804 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:05.626424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'services' on Instance uuid ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:40:05.794854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3a0e2cd3-87ea-4915-a6d9-6ba3e0e2f95d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments/071eed1e-d685-4aa7-bee9-7325123ea1e4" status: 202 len: 0 microversion: 2.1 time: 0.263561 Aug 05 14:40:05.795504 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 546/1060] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:40:05 2022] DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments/071eed1e-d685-4aa7-bee9-7325123ea1e4 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:40:05.804971 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:05.807093 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:05.814118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:05.814769 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:05.815208 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:05.815943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:05.816392 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:05.819380 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:05.846623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b743e55b-01c1-46b3-9b05-b2a0de480989 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046761 Aug 05 14:40:05.847193 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 515/1061] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:40:05 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:06.861162 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:06.863598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:06.869897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:06.870384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:06.870818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:06.871512 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:06.871975 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:06.872566 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:06.906153 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b33b02c3-8a58-4883-83dc-fced5b62373a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049828 Aug 05 14:40:06.906708 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 547/1062] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:40:06 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:07.918534 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:07.920711 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:07.927358 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:07.927811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:07.928244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:07.928948 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:07.929397 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:07.929814 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:07.960191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dd562cb5-bc7d-4fa4-9013-a6d7fba7d78b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045603 Aug 05 14:40:07.960767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 516/1063] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:40:07 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:40:08.021728 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:08.022252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:08.028523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:08.029004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:08.029438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:08.030231 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:08.030571 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:08.030990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:08.055707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:40:08.299025 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8492ee2a-614b-4ad2-b5ed-7bdaf196ab32 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 204 len: 0 microversion: 2.1 time: 0.280882 Aug 05 14:40:08.299561 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 548/1064] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:40:08 2022] DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:40:08.308476 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:08.311681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:08.315482 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:08.315964 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:08.316400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:08.318054 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:08.318612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:08.319040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:08.453934 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:08.461576 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-869bc44c-db58-4310-91d3-777341d7c249 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1680 microversion: 2.1 time: 0.157045 Aug 05 14:40:08.467354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 517/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:08 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:40:09.483802 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:09.484529 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:09.491302 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:09.491776 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:09.492208 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:09.492939 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:09.493387 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:09.493806 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:09.622360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:09.629695 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1edc588a-cffd-4a6d-beed-89935f1ad90c tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1680 microversion: 2.1 time: 0.150137 Aug 05 14:40:09.630260 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 549/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:09 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:10.651072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:10.651622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:10.658064 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:10.658538 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:10.658973 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:10.659659 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:10.660106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:10.660556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:10.796535 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:10.805138 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-15c8373d-a135-459a-8546-cd8c1f296feb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1680 microversion: 2.1 time: 0.157974 Aug 05 14:40:10.805949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 518/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:10 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:11.249213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-790074e5-7f64-4063-b668-494c362ea73b req-a9bd848e-ef79-43d8-b712-682f19462760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7c9c9f-0250-411b-8fdb-cbd85886ffc8", "name": "network-vif-deleted", "tag": "538645fc-bbc1-4f81-bcb7-fde9a531dae5"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:11.261353 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-790074e5-7f64-4063-b668-494c362ea73b req-a9bd848e-ef79-43d8-b712-682f19462760 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:11.261353 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-790074e5-7f64-4063-b668-494c362ea73b req-a9bd848e-ef79-43d8-b712-682f19462760 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:11.261353 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-790074e5-7f64-4063-b668-494c362ea73b req-a9bd848e-ef79-43d8-b712-682f19462760 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:11.272446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-790074e5-7f64-4063-b668-494c362ea73b req-a9bd848e-ef79-43d8-b712-682f19462760 service nova] Creating event network-vif-deleted:538645fc-bbc1-4f81-bcb7-fde9a531dae5 for instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 on hv-cinder-80295 Aug 05 14:40:11.277368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-790074e5-7f64-4063-b668-494c362ea73b req-a9bd848e-ef79-43d8-b712-682f19462760 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Aug 05 14:40:11.277963 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 550/1068] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:11.826750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:11.827305 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:11.833802 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:11.834299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:11.834715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:11.835400 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:11.835847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:11.836264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:11.868361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:11.868879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:11.869311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:11.869761 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'fault' on Instance uuid ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:40:11.914434 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:11.922811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-961b2cdd-6fca-46c7-86ba-f73817ee0a82 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 200 len: 1330 microversion: 2.1 time: 0.099954 Aug 05 14:40:11.923510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 519/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:11 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:12.946274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:12.946972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:12.953492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:12.953967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:12.954395 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:12.955069 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:12.955519 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:12.955936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:12.969828 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 HTTP/1.1 Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:40:12.971476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:40:12.973132 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'ca7c9c9f-0250-411b-8fdb-cbd85886ffc8'} Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:40:12.974307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:40:12.975995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:40:12.977538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:40:12.977538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1b959f50-bae4-4376-91e1-865d4e4e8318 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 404 len: 111 microversion: 2.1 time: 0.031435 Aug 05 14:40:12.977538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 551/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:12 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:40:12.982784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-546bdc1a-87fa-4a0b-853e-cc9309a17a14 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '.version_select at 0x7fa75d9f9670>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:13.094378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-546bdc1a-87fa-4a0b-853e-cc9309a17a14 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-148201452" status: 202 len: 0 microversion: 2.1 time: 0.115369 Aug 05 14:40:13.094982 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 520/1071] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Aug 5 14:40:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-148201452 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:40:13.867370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-44dc27bd-8f8b-4a56-b879-7f62cf5d5680 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: .version_select at 0x7fa75d2b98b0>, body: {"keypair": {"name": "tempest-keypair-134522625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADARDdeYfh1lVhiEr0+ZKSLrrvD29SwumbsHJExfM2OBsKRq9FU4CffF7XumFcz6b2KgXa/laom85WlOcVtQHZC1DTQ+66f/yiHR/wFhr6uBLgRYdCCZM0QOTkAtqKH/Q=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:13.883141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-44dc27bd-8f8b-4a56-b879-7f62cf5d5680 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:40:13.886960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-44dc27bd-8f8b-4a56-b879-7f62cf5d5680 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:40:13.899156 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR oslo.messaging._drivers.impl_rabbit [None req-44dc27bd-8f8b-4a56-b879-7f62cf5d5680 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [6abe3420-852a-4bf4-a67c-83a081aeae5d] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 14:40:14.907416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [None req-44dc27bd-8f8b-4a56-b879-7f62cf5d5680 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [6abe3420-852a-4bf4-a67c-83a081aeae5d] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 46704. Aug 05 14:40:14.979619 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-44dc27bd-8f8b-4a56-b879-7f62cf5d5680 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116158 Aug 05 14:40:14.980213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 552/1072] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:40:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:16.962900 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1979911703", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9d713f-ec54-40f7-9839-9e1dddc5814f"}], "security_groups": [{"name": "tempest-securitygroup--1099328749"}], "key_name": "tempest-keypair-134522625", "user_data": "}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:17.066715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] validate_networks() for [('bb9d713f-ec54-40f7-9839-9e1dddc5814f', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:40:17.433253 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:40:17.433675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:40:17.434169 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:40:17.434556 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:40:17.434995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:40:17.444203 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:17.444707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:17.445139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:17.445857 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:17.446313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:17.446731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:17.463702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:40:17.467851 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:40:17.478616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:40:17.480872 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:40:17.614972 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3323b018-22ee-486c-a8ee-14e3279accbb tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.656417 Aug 05 14:40:17.615680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 521/1073] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:40:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:40:17.627477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-df10b06f-e6f6-4c69-a687-fbcce2af6a51 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:17.628268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-df10b06f-e6f6-4c69-a687-fbcce2af6a51 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:17.793384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-df10b06f-e6f6-4c69-a687-fbcce2af6a51 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:17.800316 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-df10b06f-e6f6-4c69-a687-fbcce2af6a51 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1241 microversion: 2.1 time: 0.177596 Aug 05 14:40:17.800919 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 553/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:17 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1241 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:18.823114 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:18.823755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:18.829984 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:18.830464 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:18.830895 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:18.831581 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:18.832030 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:18.832473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:18.947630 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:18.955135 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ac08264a-f2c4-49f6-bf5b-624ff37af1df tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1237 microversion: 2.1 time: 0.137640 Aug 05 14:40:18.955706 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 522/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:18 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1237 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:19.977379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:19.977995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:19.984454 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:19.984946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:19.985379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:19.986073 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:19.986524 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:19.986950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:20.054921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:20.060189 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-debeed1a-9671-4393-a34f-c46d5a1ef63f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1299 microversion: 2.1 time: 0.087675 Aug 05 14:40:20.060770 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 554/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:19 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:21.081864 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:21.082569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:21.089757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:21.090239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:21.090715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:21.091361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:21.092070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:21.092521 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:21.223055 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:21.230785 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3223cf72-052b-410d-8e6a-587cc8caf948 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.152720 Aug 05 14:40:21.231296 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 523/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:21 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:21.355681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-d3d301dc-4059-4934-bdc5-73620e168d11 req-09c1d275-2547-4db0-aa46-949b3b7e9156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258a17a5-dad7-4d81-b7c5-5a661bb9fd3f", "tag": "a373abd0-763b-4244-89f8-bdb3b50e5a14"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:21.367158 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-d3d301dc-4059-4934-bdc5-73620e168d11 req-09c1d275-2547-4db0-aa46-949b3b7e9156 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:21.367640 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-d3d301dc-4059-4934-bdc5-73620e168d11 req-09c1d275-2547-4db0-aa46-949b3b7e9156 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:21.368259 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-d3d301dc-4059-4934-bdc5-73620e168d11 req-09c1d275-2547-4db0-aa46-949b3b7e9156 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:21.379595 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-d3d301dc-4059-4934-bdc5-73620e168d11 req-09c1d275-2547-4db0-aa46-949b3b7e9156 service nova] Creating event network-changed:a373abd0-763b-4244-89f8-bdb3b50e5a14 for instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f on hv-cinder-80295 Aug 05 14:40:21.384904 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-d3d301dc-4059-4934-bdc5-73620e168d11 req-09c1d275-2547-4db0-aa46-949b3b7e9156 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Aug 05 14:40:21.385799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 555/1078] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:22.251105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:22.251717 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:22.258140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:22.258621 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:22.259056 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:22.259742 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:22.260194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:22.260645 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:22.390250 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:22.398679 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2e527684-98ad-4433-8c22-1f47f1eed86e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.150868 Aug 05 14:40:22.399252 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 524/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:22 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:23.419646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:23.420379 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:23.426977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:23.427453 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:23.427888 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:23.428642 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:23.429906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:23.430376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:23.565249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:23.573313 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-75a3c5c3-3cf5-4110-b388-76549eebbfb3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.157944 Aug 05 14:40:23.573870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 556/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:23 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:24.594001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:24.594611 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:24.600967 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:24.601478 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:24.601901 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:24.602586 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:24.603035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:24.603452 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:24.730890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:24.738342 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3674a46e-9d5c-4031-9b6a-f6c761706a2b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.148519 Aug 05 14:40:24.738920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 525/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:24 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:25.759848 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:25.760456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:25.767317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:25.767777 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:25.768204 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:25.768918 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:25.769365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:25.769782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:25.901661 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:25.909263 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8425bd1a-0f97-4eb0-ac84-19165863c28f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.153900 Aug 05 14:40:25.909825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 557/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:25 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:26.928524 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:26.929135 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:26.935603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:26.936163 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:26.936624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:26.937314 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:26.937762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:26.938177 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:27.068787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:27.077224 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-892d4f2a-c35b-48f1-8fc2-d7140bca2605 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.152597 Aug 05 14:40:27.077794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 526/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:26 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:28.098238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:28.098850 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:28.101248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=6 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:28.106740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:28.112678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:28.112678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:28.112678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:28.112678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:28.113024 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:28.237872 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:28.245238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-20b97b17-fe86-46b0-88c7-0445be573600 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.150801 Aug 05 14:40:28.247191 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 558/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:28 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:28.527479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-797ce75b-e003-4b96-86fa-e28976ca69c9 req-867a0d89-988a-4718-a815-7fc6b025e35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258a17a5-dad7-4d81-b7c5-5a661bb9fd3f", "name": "network-vif-plugged", "status": "completed", "tag": "a373abd0-763b-4244-89f8-bdb3b50e5a14"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:28.532705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:28.533422 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:28.539036 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-797ce75b-e003-4b96-86fa-e28976ca69c9 req-867a0d89-988a-4718-a815-7fc6b025e35f service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:28.540074 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-797ce75b-e003-4b96-86fa-e28976ca69c9 req-867a0d89-988a-4718-a815-7fc6b025e35f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:28.540537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-797ce75b-e003-4b96-86fa-e28976ca69c9 req-867a0d89-988a-4718-a815-7fc6b025e35f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:28.551192 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-797ce75b-e003-4b96-86fa-e28976ca69c9 req-867a0d89-988a-4718-a815-7fc6b025e35f service nova] Creating event network-vif-plugged:a373abd0-763b-4244-89f8-bdb3b50e5a14 for instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f on hv-cinder-80295 Aug 05 14:40:28.556653 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-797ce75b-e003-4b96-86fa-e28976ca69c9 req-867a0d89-988a-4718-a815-7fc6b025e35f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033808 Aug 05 14:40:28.557303 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 527/1085] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:29.265674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:29.266294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:29.272766 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:29.273250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:29.273692 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:29.274386 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:29.274932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:29.275367 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:29.279377 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:29.407650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:29.415877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1bcb7465-0aca-4e58-9f2a-ca116512c316 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1367 microversion: 2.1 time: 0.153502 Aug 05 14:40:29.416610 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 559/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:29 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:30.439100 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:30.439794 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:30.442814 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:30.449370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:30.449849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:30.450649 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:30.451133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:30.451583 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:30.452008 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:30.456105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=93 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:30.588356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:40:30.596641 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d5d6be56-131b-4877-9117-20baeebebc3d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1557 microversion: 2.1 time: 0.162433 Aug 05 14:40:30.597216 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 528/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:40:30 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:40:30.616349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:40:30.616874 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:40:30.619940 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:40:30.624612 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:30.625104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:30.625544 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:30.626240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:30.626699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:30.627135 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:30.709877 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f011a2dc-c270-475d-abc4-4be54a81213a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097311 Aug 05 14:40:30.710486 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 560/1088] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:40:30 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:40:31.928979 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-3a6d0d85-3240-4aa4-add1-d392174ee33e req-ac6e76c5-7989-46d8-9a04-327f181e2c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258a17a5-dad7-4d81-b7c5-5a661bb9fd3f", "tag": "a373abd0-763b-4244-89f8-bdb3b50e5a14"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:40:31.941677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-3a6d0d85-3240-4aa4-add1-d392174ee33e req-ac6e76c5-7989-46d8-9a04-327f181e2c6b service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:40:31.942133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-3a6d0d85-3240-4aa4-add1-d392174ee33e req-ac6e76c5-7989-46d8-9a04-327f181e2c6b service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:40:31.942765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-3a6d0d85-3240-4aa4-add1-d392174ee33e req-ac6e76c5-7989-46d8-9a04-327f181e2c6b service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:40:31.956286 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-3a6d0d85-3240-4aa4-add1-d392174ee33e req-ac6e76c5-7989-46d8-9a04-327f181e2c6b service nova] Creating event network-changed:a373abd0-763b-4244-89f8-bdb3b50e5a14 for instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f on hv-cinder-80295 Aug 05 14:40:31.961759 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-3a6d0d85-3240-4aa4-add1-d392174ee33e req-ac6e76c5-7989-46d8-9a04-327f181e2c6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036606 Aug 05 14:40:31.962363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 529/1089] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:41:47.002374 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=8 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:41:47.003104 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:41:47.061169 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:47.061664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:47.067526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:47.068005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:47.068461 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:47.069146 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:47.069598 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:47.070021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:47.094663 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8ea28076-3c88-4c4b-96f1-34ddf260f38b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/ips" status: 200 len: 150 microversion: 2.1 time: 0.094309 Aug 05 14:41:47.095209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 561/1090] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:41:46 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:41:49.714190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:41:49.714942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=7 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:41:49.720317 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46853b1b-a786-4f57-a524-239052f170f5"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:41:49.726458 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:49.728860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:49.729347 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:49.729787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:49.730479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:49.730941 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:49.732034 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:50.494512 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ca013b22-1d6f-4ea8-be88-f34f27e35394 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782141 Aug 05 14:41:50.495136 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 530/1091] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:41:49 2022] POST /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:41:52.365626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:52.366166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:52.372764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:52.373192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:52.373633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:52.374349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:52.374812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:52.375243 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:52.399537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:41:52.662751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-14767b03-e45f-4db5-b6fc-90d24e95fe28 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 204 len: 0 microversion: 2.1 time: 0.300679 Aug 05 14:41:52.666331 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 562/1092] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:41:52 2022] DELETE /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:41:52.674315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:52.675043 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:52.681450 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:52.681931 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:52.682367 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:52.683159 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:52.683617 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:52.684041 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:52.823700 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:41:52.832035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5355742b-fe4a-4c65-b66e-7cb8e594a0c6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1575 microversion: 2.1 time: 0.163439 Aug 05 14:41:52.832680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 531/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:52 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:41:53.855671 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:53.856293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:53.863325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:53.863961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:53.864229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:53.864944 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:53.865403 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:53.865829 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:53.997083 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:41:54.004941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7d430f45-172d-4594-b030-f59c1d3ee1b0 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1575 microversion: 2.1 time: 0.153638 Aug 05 14:41:54.009046 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 563/1094] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:53 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:41:55.026494 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:55.027248 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:55.034145 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:55.034565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:55.035001 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:55.035693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:55.036268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:55.036729 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:55.175127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:41:55.184182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b6c1534a-5ac0-484f-ac7d-a0a14b289997 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1575 microversion: 2.1 time: 0.161661 Aug 05 14:41:55.184797 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 532/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:55 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:41:55.507085 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-ac73ea58-586b-4531-8a1f-e095d4be187a req-15792ddd-f1fc-4691-8fd1-3a78056f6181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a699c20b-23fc-40e9-ac3d-d835d5b7397c", "name": "network-vif-deleted", "tag": "ebaa79c4-f517-486c-a403-bb280d2fd64d"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:41:55.530405 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-ac73ea58-586b-4531-8a1f-e095d4be187a req-15792ddd-f1fc-4691-8fd1-3a78056f6181 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:55.530893 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-ac73ea58-586b-4531-8a1f-e095d4be187a req-15792ddd-f1fc-4691-8fd1-3a78056f6181 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:55.531360 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-ac73ea58-586b-4531-8a1f-e095d4be187a req-15792ddd-f1fc-4691-8fd1-3a78056f6181 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:55.545548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-ac73ea58-586b-4531-8a1f-e095d4be187a req-15792ddd-f1fc-4691-8fd1-3a78056f6181 service nova] Creating event network-vif-deleted:ebaa79c4-f517-486c-a403-bb280d2fd64d for instance a699c20b-23fc-40e9-ac3d-d835d5b7397c on hv-cinder-80295 Aug 05 14:41:55.550699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-ac73ea58-586b-4531-8a1f-e095d4be187a req-15792ddd-f1fc-4691-8fd1-3a78056f6181 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111852 Aug 05 14:41:55.551580 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 564/1096] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:41:56.210817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:56.211486 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:56.218571 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:56.219057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:56.219495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:56.220199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:56.220694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:56.221110 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:56.266913 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:56.267399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:56.267841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:56.268288 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.objects.instance [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lazy-loading 'fault' on Instance uuid a699c20b-23fc-40e9-ac3d-d835d5b7397c {{(pid=118052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:41:56.313473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:41:56.322196 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-71d8910a-8e06-48a3-9670-6feab8906e89 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 200 len: 1229 microversion: 2.1 time: 0.119335 Aug 05 14:41:56.322993 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 533/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:56 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 1229 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:41:57.346738 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:57.347349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:57.353399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:57.353882 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:57.354314 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:57.355002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:57.355449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:57.355897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:57.369604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] HTTP exception thrown: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Request method failure captured: Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c HTTP/1.1 Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Stx1BCqsM27a_Enho3V87uywpYqRcKGkJMNU8mRMcCzLqcAvINjdTRu5ujApmMQbxapVjQXhL7uTVcN3karD69R9_vd4Z08Zo7id7YmP3FC9-mhLhftsEomFrLUOWyL9fbZ7xtY6rW7747ULyPjV-Okfu8es_OrFqTr2Ld0ivCcYoE Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:41:57.371203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d408cabccaa44c338d6031955d3a1f7c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: f7b9ccd1b8cc4832a9c77513b5f21815 Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:41:57.373546 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'a699c20b-23fc-40e9-ac3d-d835d5b7397c'} Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:41:57.374450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:41:57.375825 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:57.377248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Returning 404 to user: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:41:57.377248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-72f841c6-3817-4d12-8905-25696bb9207f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 404 len: 111 microversion: 2.1 time: 0.031371 Aug 05 14:41:57.377248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 565/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:57 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:41:57.422198 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1391716821", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-402318749", "security_groups": [{"name": "tempest-secgroup-smoke-966977818"}], "block_device_mapping_v2": [{"uuid": "41e5a089-35c0-46a1-a91f-fe896904cc29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "190f2fff-2ff1-45fd-bd0d-e0bb27a89b96"}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:41:57.535113 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] validate_networks() for [('190f2fff-2ff1-45fd-bd0d-e0bb27a89b96', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:41:57.906147 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:41:57.906574 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:41:57.907040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:41:57.907474 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:41:57.907881 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:41:57.917049 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:57.917529 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:57.917962 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:57.918683 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:57.919139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:57.919568 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:57.936872 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for project d408cabccaa44c338d6031955d3a1f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:41:57.941105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for user f7b9ccd1b8cc4832a9c77513b5f21815 and project d408cabccaa44c338d6031955d3a1f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:41:58.010705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:41:58.012801 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41e5a089-35c0-46a1-a91f-fe896904cc29',volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:41:58.027603 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46853b1b-a786-4f57-a524-239052f170f5"}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:41:58.035741 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:58.036268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:58.036797 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:58.037238 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:58.037939 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:58.038399 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:58.038837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:58.120745 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Invalid volume: volume 46853b1b-a786-4f57-a524-239052f170f5 is already attached to instances: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: POST /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments HTTP/1.1 Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 74 Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:41:58.125942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {"volumeAttachment": {"volumeId": "46853b1b-a786-4f57-a524-239052f170f5"}} Aug 05 14:41:58.127649 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Invalid volume: volume 46853b1b-a786-4f57-a524-239052f170f5 is already attached to instances: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'server_id': '258a17a5-dad7-4d81-b7c5-5a661bb9fd3f', 'body': {'volumeAttachment': {'volumeId': '46853b1b-a786-4f57-a524-239052f170f5'}}} Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 46853b1b-a786-4f57-a524-239052f170f5 is already attached to instances: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:58.128623 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 46853b1b-a786-4f57-a524-239052f170f5 is already attached to instances: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:41:58.130075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 46853b1b-a786-4f57-a524-239052f170f5 is already attached to instances: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 400 to user: Invalid volume: volume 46853b1b-a786-4f57-a524-239052f170f5 is already attached to instances: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2509636f-167f-4764-8222-7bcca614a9fd tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101387 Aug 05 14:41:58.131665 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 566/1099] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:41:58 2022] POST /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 14:41:58.188814 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:58.189308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:58.195962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:58.196469 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:58.196907 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:58.197601 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:58.198061 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:58.198488 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:58.278032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'services' on Instance uuid 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:41:58.366755 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-150be915-e255-4bf0-bb0e-1ad89f9e3cab tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.948951 Aug 05 14:41:58.367537 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 534/1100] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:41:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 14:41:58.378139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-23a9092a-7bed-4484-be8e-62cfc3972986 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:58.378751 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-23a9092a-7bed-4484-be8e-62cfc3972986 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:58.432344 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-23a9092a-7bed-4484-be8e-62cfc3972986 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:41:58.440682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-23a9092a-7bed-4484-be8e-62cfc3972986 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1094 microversion: 2.1 time: 0.065391 Aug 05 14:41:58.440682 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 535/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:58 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:41:58.529508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9fcf47f7-0ba2-46d8-ba81-c17f9debb05a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments/46853b1b-a786-4f57-a524-239052f170f5" status: 202 len: 0 microversion: 2.1 time: 0.344635 Aug 05 14:41:58.530229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 567/1102] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:41:58 2022] DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments/46853b1b-a786-4f57-a524-239052f170f5 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 14:41:58.538741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:58.541077 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:58.548264 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:58.548784 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:58.549214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:58.549960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:58.550354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:58.550775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:58.578793 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9bf577c8-11b4-48b3-898b-edce0d29472d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Aug 05 14:41:58.579345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 536/1103] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:41:58 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:41:59.460721 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d40e40cb-4640-42db-95d3-9baaf75e8668 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:59.461429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d40e40cb-4640-42db-95d3-9baaf75e8668 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:59.520810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d40e40cb-4640-42db-95d3-9baaf75e8668 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:41:59.528471 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d40e40cb-4640-42db-95d3-9baaf75e8668 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1094 microversion: 2.1 time: 0.071888 Aug 05 14:41:59.529912 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 568/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:41:59 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:41:59.591870 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:41:59.594567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:41:59.600871 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:59.601346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:59.601776 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:59.602456 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:41:59.602901 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:41:59.603315 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:41:59.631878 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-112c6cfa-cb00-4cd6-bcc0-11e4c6d74c8a tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Aug 05 14:41:59.632457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 537/1105] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:41:59 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:00.550141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-60eaedac-c699-43f0-939c-75b46f6113c9 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:00.550761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-60eaedac-c699-43f0-939c-75b46f6113c9 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:00.603857 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-60eaedac-c699-43f0-939c-75b46f6113c9 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:00.610816 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-60eaedac-c699-43f0-939c-75b46f6113c9 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1094 microversion: 2.1 time: 0.064618 Aug 05 14:42:00.611384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 569/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:00 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:00.643766 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:00.645954 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:00.652244 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:00.659190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:00.659190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:00.659190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:00.659190 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:00.659629 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:00.682359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-015d6e4c-be03-46df-9b0c-7b654e28ea72 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042504 Aug 05 14:42:00.683108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 538/1107] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:42:00 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 14:42:00.745432 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:00.745954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:00.752586 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:00.753076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:00.753507 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:00.754193 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:00.754648 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:00.755071 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:00.780439 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:42:01.062539 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-88ec51f7-703a-4d37-b8f1-ca6ea9c34e3e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 204 len: 0 microversion: 2.1 time: 0.320540 Aug 05 14:42:01.063055 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 570/1108] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:42:00 2022] DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:42:01.071100 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:01.074072 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:01.077567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:01.078050 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:01.078484 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:01.079167 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:01.079619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:01.080045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:01.209211 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:01.216862 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-e0acb658-365d-4a7b-86ca-0724514cc442 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1682 microversion: 2.1 time: 0.149559 Aug 05 14:42:01.217437 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 539/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:01 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:01.632477 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a972e09b-9024-4c86-90c7-b52336442484 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:01.633267 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a972e09b-9024-4c86-90c7-b52336442484 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:01.685196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a972e09b-9024-4c86-90c7-b52336442484 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:01.692670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a972e09b-9024-4c86-90c7-b52336442484 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1094 microversion: 2.1 time: 0.064426 Aug 05 14:42:01.693401 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 571/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:01 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:02.238994 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:02.239597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:02.245940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:02.248520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:02.248520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:02.248520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:02.248520 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:02.249052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:02.379324 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:02.386741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-af46b025-5231-40c4-9bff-54edc05d79b5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1682 microversion: 2.1 time: 0.152319 Aug 05 14:42:02.388086 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 540/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:02 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:02.713772 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:02.714380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:02.725273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:02.725759 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:02.726192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:02.726922 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:02.727370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:02.727788 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:02.788538 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:02.796795 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-15e66287-245b-415b-9e3a-543274c4f65c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1144 microversion: 2.1 time: 0.086660 Aug 05 14:42:02.797368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 572/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:02 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:03.407961 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:03.408612 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:03.415187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:03.415609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:03.416057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:03.416787 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:03.417247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:03.417675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:03.554920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:03.563716 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-31a78a1e-431d-4844-9d0f-a5f126b354d3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1682 microversion: 2.1 time: 0.160459 Aug 05 14:42:03.564360 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 541/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:03 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:03.819019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:03.819747 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:03.826456 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:03.827630 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:03.828106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:03.828937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:03.829397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:03.829834 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:03.892775 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:03.900972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0468fa77-3808-434a-99e8-8336f2a4d1cb tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1136 microversion: 2.1 time: 0.086720 Aug 05 14:42:03.901766 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 573/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:03 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:04.020894 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-330a7f49-eb85-4095-a571-b796de509abd req-5eba0250-2ffe-497d-bbf5-079040cdaf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258a17a5-dad7-4d81-b7c5-5a661bb9fd3f", "name": "network-vif-deleted", "tag": "a373abd0-763b-4244-89f8-bdb3b50e5a14"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:04.030025 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-330a7f49-eb85-4095-a571-b796de509abd req-5eba0250-2ffe-497d-bbf5-079040cdaf42 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:04.030602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-330a7f49-eb85-4095-a571-b796de509abd req-5eba0250-2ffe-497d-bbf5-079040cdaf42 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:04.031207 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-330a7f49-eb85-4095-a571-b796de509abd req-5eba0250-2ffe-497d-bbf5-079040cdaf42 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:04.042085 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-330a7f49-eb85-4095-a571-b796de509abd req-5eba0250-2ffe-497d-bbf5-079040cdaf42 service nova] Creating event network-vif-deleted:a373abd0-763b-4244-89f8-bdb3b50e5a14 for instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f on hv-cinder-80295 Aug 05 14:42:04.047813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-330a7f49-eb85-4095-a571-b796de509abd req-5eba0250-2ffe-497d-bbf5-079040cdaf42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030640 Aug 05 14:42:04.048497 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 542/1115] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:42:04.586335 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:04.587211 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:04.594325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:04.594898 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:04.595403 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:04.596274 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:04.596798 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:04.597438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:04.650713 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:04.651545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:04.652116 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:04.652821 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'fault' on Instance uuid 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:42:04.703751 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:04.721306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b06cf4f5-c04f-4ee1-be9d-88806326fc13 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 200 len: 1331 microversion: 2.1 time: 0.139129 Aug 05 14:42:04.722093 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 574/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:04 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:04.925656 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:04.927026 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:04.933807 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:04.935067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:04.935681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:04.940991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:04.941618 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:04.942131 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:05.013491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:05.022958 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-91ac310e-d8a0-42ca-a998-06f866762f22 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1210 microversion: 2.1 time: 0.104267 Aug 05 14:42:05.023918 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 543/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:04 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:05.742941 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:05.744224 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:05.752072 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:05.752903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:05.753349 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:05.754067 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:05.754555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:05.754983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:05.770305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f HTTP/1.1 Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:42:05.772035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:42:05.773864 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '258a17a5-dad7-4d81-b7c5-5a661bb9fd3f'} Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:42:05.775100 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:42:05.776545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:42:05.777883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:42:05.777883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-de00c9e6-a753-4e40-99e7-57d6929632ec tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 404 len: 111 microversion: 2.1 time: 0.034581 Aug 05 14:42:05.777883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 575/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:05 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:42:05.784866 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-97839c34-f818-4cd8-bb83-f39256c2d0fc tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '.version_select at 0x7fa75e329d30>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:05.880493 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-97839c34-f818-4cd8-bb83-f39256c2d0fc tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134522625" status: 202 len: 0 microversion: 2.1 time: 0.101186 Aug 05 14:42:05.883867 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 544/1119] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Aug 5 14:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134522625 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:42:06.043749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:06.044371 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:06.051493 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:06.052209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:06.052674 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:06.053560 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:06.054478 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:06.054921 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:06.229605 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:06.237223 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f83386f9-425a-435c-a7cb-68ba127e1a90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1277 microversion: 2.1 time: 0.197294 Aug 05 14:42:06.237799 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 576/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:06 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:06.680210 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-d2b1ddfd-43f4-414a-9c01-2b8c38684359 req-772f4519-6d7b-4c0d-ab48-163b34a7014b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fe0551-af11-4c71-965b-dfb1a1068d9a", "tag": "32492fe9-d310-4716-a3db-25a2b51dcc8f"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:06.692357 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d2b1ddfd-43f4-414a-9c01-2b8c38684359 req-772f4519-6d7b-4c0d-ab48-163b34a7014b service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:06.692985 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d2b1ddfd-43f4-414a-9c01-2b8c38684359 req-772f4519-6d7b-4c0d-ab48-163b34a7014b service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:06.693477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d2b1ddfd-43f4-414a-9c01-2b8c38684359 req-772f4519-6d7b-4c0d-ab48-163b34a7014b service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:06.704964 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-d2b1ddfd-43f4-414a-9c01-2b8c38684359 req-772f4519-6d7b-4c0d-ab48-163b34a7014b service nova] Creating event network-changed:32492fe9-d310-4716-a3db-25a2b51dcc8f for instance 06fe0551-af11-4c71-965b-dfb1a1068d9a on hv-cinder-80295 Aug 05 14:42:06.709639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-d2b1ddfd-43f4-414a-9c01-2b8c38684359 req-772f4519-6d7b-4c0d-ab48-163b34a7014b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040308 Aug 05 14:42:06.714105 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 545/1121] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:06.890813 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-153d31f3-3206-474b-869a-1905f6158be0 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: .version_select at 0x7fa75d383280>, body: {"keypair": {"name": "tempest-keypair-428541335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJDBpu0d2hfwr7bRds0qqnCE2JzubxruEa4IpUjcQXHdTc4h3ta/fov+HiGe430Qgcah+kjkxih1j63Bc6QTV8UWdFCphvgO+RF5F3Uv87b/RMUODWbkuEzBrClC/aahA=="}} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:06.907194 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-153d31f3-3206-474b-869a-1905f6158be0 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:42:06.910879 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.quota [None req-153d31f3-3206-474b-869a-1905f6158be0 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'key_pairs'} {{(pid=118053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:42:06.988894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-153d31f3-3206-474b-869a-1905f6158be0 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103011 Aug 05 14:42:06.989670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 577/1122] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Aug 5 14:42:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:07.258372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:07.259345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:07.266890 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:07.267457 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:07.267930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:07.268669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:07.269124 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:07.269565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:07.416588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:07.424847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8c15eb1c-cd53-4e84-aa65-c308b987649d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.170719 Aug 05 14:42:07.425746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 546/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:07 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:08.447840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:08.448472 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:08.466555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:08.467050 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:08.467526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:08.468245 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:08.468729 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:08.469157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:08.692886 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:08.700746 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7c30641c-eb07-4799-973a-0f96d9b6d7d3 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.257413 Aug 05 14:42:08.701535 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 578/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:08 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:09.215238 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1791654070", "imageRef": "2ba0a699-6d4a-4dc2-906a-08c6432d8860", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9d713f-ec54-40f7-9839-9e1dddc5814f"}], "security_groups": [{"name": "tempest-securitygroup--1284498231"}], "key_name": "tempest-keypair-428541335", "user_data": "}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:09.223640 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:09.224346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=8 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:09.320214 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] validate_networks() for [('bb9d713f-ec54-40f7-9839-9e1dddc5814f', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:42:09.683106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:42:09.683528 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:42:09.684021 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:42:09.684473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:42:09.684893 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:42:09.693956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:09.694564 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:09.695003 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:09.695722 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:09.696169 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:09.696629 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:09.713370 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:42:09.718369 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Getting quotas for user 0cb8261b328c4cd8956762971fefceee and project bc63bf4a15624098aa5568cad2c003ae. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:42:09.725396 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:09.726013 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:09.729869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:42:09.732120 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ba0a699-6d4a-4dc2-906a-08c6432d8860',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:42:09.732281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:09.732801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:09.733789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:09.734485 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:09.734934 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:09.735358 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:09.753261 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:09.874622 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:09.881837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9e0afe98-bcab-4515-8b71-14e2639615b6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.160296 Aug 05 14:42:09.882441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 579/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:09 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:09.909463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9bddc7b2-5e90-47c0-aa63-578f8dab35aa tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698564 Aug 05 14:42:09.910125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 547/1126] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:42:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:42:09.921322 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d3643630-f960-4a3c-a5f5-c6e8df32f801 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:09.921932 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d3643630-f960-4a3c-a5f5-c6e8df32f801 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:09.975440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d3643630-f960-4a3c-a5f5-c6e8df32f801 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:09.981974 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d3643630-f960-4a3c-a5f5-c6e8df32f801 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1241 microversion: 2.1 time: 0.064906 Aug 05 14:42:09.982545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 580/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:09 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:10.903847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:10.904495 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:10.916146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:10.917067 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:10.917860 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:10.919109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:10.919935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:10.920782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:11.001838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:11.002448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:11.009044 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:11.009526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:11.009961 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:11.010664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:11.011112 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:11.011536 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:11.070778 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:11.079042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a5add804-e901-44f7-a654-c30a07eb7272 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.179687 Aug 05 14:42:11.079614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 548/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:10 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:11.087727 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:11.095553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a3ab9582-3df5-44d8-b7ea-484650c08487 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1237 microversion: 2.1 time: 0.097714 Aug 05 14:42:11.096110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 581/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:10 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:12.100031 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:12.100672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:12.107469 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:12.107958 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:12.109232 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:12.109969 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:12.110379 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:12.110802 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:12.118532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:12.119172 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:12.127245 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:12.127740 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:12.128240 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:12.128982 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:12.129436 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:12.129883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:12.140987 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:12.219473 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:12.228347 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4cefbd06-e915-4dea-9a84-4fe898e66d39 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1299 microversion: 2.1 time: 0.113484 Aug 05 14:42:12.229035 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 582/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:12 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:12.287922 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:12.296176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ea0b641c-35eb-4b83-9d15-3b10a8c9a7e5 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.199833 Aug 05 14:42:12.298710 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 549/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:12 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:13.251646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:13.252260 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:13.258782 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:13.259265 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:13.259699 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:13.260391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:13.260861 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:13.261283 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:13.317282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:13.317911 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:13.325063 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:13.325623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:13.326126 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:13.327035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:13.327669 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:13.327920 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:13.433383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:13.441106 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-40bbb2fe-7c35-4f98-871d-a0fecdefbe97 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.194555 Aug 05 14:42:13.441687 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 583/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:13 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:13.446306 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-22ad0cf1-9a2e-42c0-9880-004b0c286b83 req-2008e2b8-a10c-4208-80ab-f8e7d853fe36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f4287c-f5a4-4c87-b293-c6d173edf59e", "tag": "475a3ea1-c22d-4b23-a1f6-fb0f324c577b"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:13.459489 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-22ad0cf1-9a2e-42c0-9880-004b0c286b83 req-2008e2b8-a10c-4208-80ab-f8e7d853fe36 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:13.459972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-22ad0cf1-9a2e-42c0-9880-004b0c286b83 req-2008e2b8-a10c-4208-80ab-f8e7d853fe36 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:13.460407 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-22ad0cf1-9a2e-42c0-9880-004b0c286b83 req-2008e2b8-a10c-4208-80ab-f8e7d853fe36 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:13.472644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-22ad0cf1-9a2e-42c0-9880-004b0c286b83 req-2008e2b8-a10c-4208-80ab-f8e7d853fe36 service nova] Creating event network-changed:475a3ea1-c22d-4b23-a1f6-fb0f324c577b for instance 14f4287c-f5a4-4c87-b293-c6d173edf59e on hv-cinder-80295 Aug 05 14:42:13.477590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-22ad0cf1-9a2e-42c0-9880-004b0c286b83 req-2008e2b8-a10c-4208-80ab-f8e7d853fe36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034491 Aug 05 14:42:13.478192 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 584/1133] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:13.504040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:13.511610 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-1950880d-2997-4d1a-8729-497029ff0694 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.198404 Aug 05 14:42:13.512178 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 550/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:13 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:14.462933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:14.463632 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:14.470624 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:14.471151 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:14.471590 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:14.472280 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:14.472756 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:14.473176 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:14.532898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:14.534082 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:14.540991 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:14.541510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:14.541952 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:14.542651 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:14.543101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:14.543522 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:14.638651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:14.648700 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-ef16eb45-dcea-416f-915d-18e9cd424069 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.190422 Aug 05 14:42:14.649650 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 585/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:14 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:14.703055 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:14.710619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b4cccfc4-2125-46e9-b7ab-1fbb71adf59f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.182527 Aug 05 14:42:14.711189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 551/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:14 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:15.672996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:15.672996 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:15.676773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:15.677279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:15.677711 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:15.678428 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:15.678942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:15.679429 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:15.731071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:15.731698 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:15.739228 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:15.739707 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:15.740139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:15.740849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:15.741301 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:15.741715 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:15.850237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:15.857946 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-256c17d4-3e6d-4b58-9248-7defb98c0f06 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.191897 Aug 05 14:42:15.865719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 586/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:15 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:15.898240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:15.906338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0048307c-49d0-4918-b6e0-7aefc29aa571 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.179142 Aug 05 14:42:15.906907 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 552/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:15 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:16.879354 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:16.880021 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:16.886389 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:16.886867 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:16.887298 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:16.887992 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:16.888458 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:16.888883 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:16.926859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:16.927600 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:16.935810 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:16.936468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:16.937146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:16.937852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:16.938300 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:16.938754 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:17.077809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:17.087068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-fc3790b2-d170-45d2-8f91-6876bea55b0b tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.211017 Aug 05 14:42:17.100294 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 587/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:16 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:17.106886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:17.114389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9ecd7fe3-75af-48f6-80e2-5b0e0211c1a6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.191397 Aug 05 14:42:17.115140 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 553/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:16 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:18.107867 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:18.109278 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:18.111723 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:18.116363 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:18.116885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:18.117317 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:18.118004 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:18.118453 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:18.118870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:18.135052 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:18.135762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:18.142391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:18.142875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:18.143313 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:18.144008 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:18.144479 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:18.144904 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:18.318499 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:18.326217 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-6e8d05c0-9f89-429d-affe-62200bdc409d tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.222224 Aug 05 14:42:18.326614 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:18.327505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 588/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:18 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:18.335189 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d2c4b794-fe35-444d-9e7b-cf2455efe79f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.203989 Aug 05 14:42:18.335768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 554/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:18 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:18.423416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:42:18.423634 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:42:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:42:19.056344 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-56aa564e-a694-4f06-836e-69152ff96626 req-08cd6acd-c022-4139-9a93-8497d471e090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fe0551-af11-4c71-965b-dfb1a1068d9a", "name": "network-vif-plugged", "status": "completed", "tag": "32492fe9-d310-4716-a3db-25a2b51dcc8f"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:19.065686 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-56aa564e-a694-4f06-836e-69152ff96626 req-08cd6acd-c022-4139-9a93-8497d471e090 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:19.066206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-56aa564e-a694-4f06-836e-69152ff96626 req-08cd6acd-c022-4139-9a93-8497d471e090 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:19.066570 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-56aa564e-a694-4f06-836e-69152ff96626 req-08cd6acd-c022-4139-9a93-8497d471e090 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:19.078032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-56aa564e-a694-4f06-836e-69152ff96626 req-08cd6acd-c022-4139-9a93-8497d471e090 service nova] Creating event network-vif-plugged:32492fe9-d310-4716-a3db-25a2b51dcc8f for instance 06fe0551-af11-4c71-965b-dfb1a1068d9a on hv-cinder-80295 Aug 05 14:42:19.086956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-56aa564e-a694-4f06-836e-69152ff96626 req-08cd6acd-c022-4139-9a93-8497d471e090 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 Aug 05 14:42:19.086956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 589/1143] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:19.347283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:19.347837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:19.354350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:19.354837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:19.355304 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:19.355995 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:19.356465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:19.356889 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:19.356998 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:19.357684 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:19.363891 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:19.364385 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:19.364847 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:19.365533 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:19.365983 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:19.366402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:19.576048 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:19.578494 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:19.586505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f25c60ab-7063-4ec9-a62c-002576603c9b tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.234280 Aug 05 14:42:19.589491 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0ca02bd3-a5cf-4a62-bb8d-f438873ffc3f tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.244134 Aug 05 14:42:19.589631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 590/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:19 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:19.589980 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 555/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:19 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:20.609466 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:20.610128 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:20.610498 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:20.610682 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:20.611897 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:20.612459 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=12 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:20.612602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:20.613774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:42:20.618207 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:20.618363 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:20.618709 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:20.618854 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:20.619138 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:20.619282 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:20.619873 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:20.619981 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:20.620321 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:20.620447 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:20.622182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:20.622307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:20.825680 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:20.829760 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:20.832523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c5f6cee3-6d29-4aaa-a3c7-d71057350a14 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1265 microversion: 2.1 time: 0.227370 Aug 05 14:42:20.833268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 556/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:20 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:20.843656 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f1028f0f-a97f-4d31-9cf6-107810e90206 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.238703 Aug 05 14:42:20.844236 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 591/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:20 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:21.098935 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-2bbf2612-2dea-4d62-a3c8-d9c42ef5d269 req-c7d8ab91-55c5-4166-bef1-9a3d58093e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f4287c-f5a4-4c87-b293-c6d173edf59e", "name": "network-vif-plugged", "status": "completed", "tag": "475a3ea1-c22d-4b23-a1f6-fb0f324c577b"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:21.111359 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-2bbf2612-2dea-4d62-a3c8-d9c42ef5d269 req-c7d8ab91-55c5-4166-bef1-9a3d58093e4e service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:21.111839 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-2bbf2612-2dea-4d62-a3c8-d9c42ef5d269 req-c7d8ab91-55c5-4166-bef1-9a3d58093e4e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:21.112272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-2bbf2612-2dea-4d62-a3c8-d9c42ef5d269 req-c7d8ab91-55c5-4166-bef1-9a3d58093e4e service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:21.124139 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-2bbf2612-2dea-4d62-a3c8-d9c42ef5d269 req-c7d8ab91-55c5-4166-bef1-9a3d58093e4e service nova] Creating event network-vif-plugged:475a3ea1-c22d-4b23-a1f6-fb0f324c577b for instance 14f4287c-f5a4-4c87-b293-c6d173edf59e on hv-cinder-80295 Aug 05 14:42:21.129343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-2bbf2612-2dea-4d62-a3c8-d9c42ef5d269 req-c7d8ab91-55c5-4166-bef1-9a3d58093e4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034237 Aug 05 14:42:21.129942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 557/1148] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:21.853972 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:21.854513 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:21.861652 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:21.862139 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:21.862617 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:21.863549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:21.864023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:21.864476 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:21.865644 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:21.866349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:21.872783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:21.873268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:21.873705 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:21.874461 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:21.874916 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:21.875345 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:22.062397 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:22.068468 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:22.070131 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-a33ef2c0-8c91-4390-ad0e-d6506a89e20a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1452 microversion: 2.1 time: 0.220222 Aug 05 14:42:22.070908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 592/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:21 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1452 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:22.076014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9b37e5da-fc84-4c4d-b3bb-f35a4127e6c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.215559 Aug 05 14:42:22.076605 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 558/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:21 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:42:22.090789 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:22.091414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:22.097958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:22.098903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:22.098903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:22.099569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:22.100055 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:22.100487 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:22.227885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:22.235801 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e3ef33bf-f22d-45ac-bebd-ed0c8522e7ba tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1452 microversion: 2.1 time: 0.148987 Aug 05 14:42:22.236362 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 593/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:22 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:23.097135 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:23.097677 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:23.104672 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:23.105152 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:23.105588 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:23.106275 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:23.106728 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:23.107756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:23.520403 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:23.529180 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5ef72b66-7406-4ae0-b955-b484ab0136e2 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1367 microversion: 2.1 time: 0.436052 Aug 05 14:42:23.529752 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 559/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:23 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:24.483606 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-153196b6-cce7-4fb8-81df-7d846ca0fb04 req-98e1e34a-00d4-40f8-8017-7f5187ac3252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fe0551-af11-4c71-965b-dfb1a1068d9a", "tag": "32492fe9-d310-4716-a3db-25a2b51dcc8f"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:24.494901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-153196b6-cce7-4fb8-81df-7d846ca0fb04 req-98e1e34a-00d4-40f8-8017-7f5187ac3252 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:24.496805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-153196b6-cce7-4fb8-81df-7d846ca0fb04 req-98e1e34a-00d4-40f8-8017-7f5187ac3252 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:24.496805 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-153196b6-cce7-4fb8-81df-7d846ca0fb04 req-98e1e34a-00d4-40f8-8017-7f5187ac3252 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:24.507337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-153196b6-cce7-4fb8-81df-7d846ca0fb04 req-98e1e34a-00d4-40f8-8017-7f5187ac3252 service nova] Creating event network-changed:32492fe9-d310-4716-a3db-25a2b51dcc8f for instance 06fe0551-af11-4c71-965b-dfb1a1068d9a on hv-cinder-80295 Aug 05 14:42:24.512990 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-153196b6-cce7-4fb8-81df-7d846ca0fb04 req-98e1e34a-00d4-40f8-8017-7f5187ac3252 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089869 Aug 05 14:42:24.514242 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 594/1153] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:24.549602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:24.550440 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:24.557160 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:24.557762 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:24.558298 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:24.559109 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:24.559687 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:24.560239 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:24.701638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:42:24.709988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-8febb5c7-4679-45e1-b68c-6d933a1994d1 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1556 microversion: 2.1 time: 0.164425 Aug 05 14:42:24.710565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 560/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:42:24 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:42:24.731597 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:42:24.732185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:42:24.738841 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:24.739573 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:24.740239 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:24.741171 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:24.741830 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:24.742467 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:24.832837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-949319b4-7e02-42e5-9b07-cbbd7687dcd4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105598 Aug 05 14:42:24.833449 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 595/1155] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Aug 5 14:42:24 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:42:26.528795 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-d08c31d7-6e02-452b-8421-834bf3aaa6ad req-25c8e588-7d5e-4db6-abde-81497a0ad6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f4287c-f5a4-4c87-b293-c6d173edf59e", "tag": "475a3ea1-c22d-4b23-a1f6-fb0f324c577b"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:42:26.539283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d08c31d7-6e02-452b-8421-834bf3aaa6ad req-25c8e588-7d5e-4db6-abde-81497a0ad6b2 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:42:26.539836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d08c31d7-6e02-452b-8421-834bf3aaa6ad req-25c8e588-7d5e-4db6-abde-81497a0ad6b2 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:42:26.540265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-d08c31d7-6e02-452b-8421-834bf3aaa6ad req-25c8e588-7d5e-4db6-abde-81497a0ad6b2 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:42:26.554499 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-d08c31d7-6e02-452b-8421-834bf3aaa6ad req-25c8e588-7d5e-4db6-abde-81497a0ad6b2 service nova] Creating event network-changed:475a3ea1-c22d-4b23-a1f6-fb0f324c577b for instance 14f4287c-f5a4-4c87-b293-c6d173edf59e on hv-cinder-80295 Aug 05 14:42:26.559603 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-d08c31d7-6e02-452b-8421-834bf3aaa6ad req-25c8e588-7d5e-4db6-abde-81497a0ad6b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034968 Aug 05 14:42:26.560288 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 561/1156] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:43:39.645508 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=15 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:43:39.646345 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=78 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:43:39.650646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:39.651135 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:39.657899 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:39.667492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:39.667492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:39.667492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:39.667492 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:39.667943 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:39.686257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3aab16cf-c6f2-4085-83a0-f3136d72f6a4 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/ips" status: 200 len: 149 microversion: 2.1 time: 0.042829 Aug 05 14:43:39.686840 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 596/1157] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Aug 5 14:43:39 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:43:42.361800 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=11 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:43:42.362560 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=66 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:43:42.367103 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92938a19-be49-4362-a462-b2ce0291d186"}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:43:42.369473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:42.375838 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:42.386330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:42.386330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:42.386330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:42.386330 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:42.386845 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:43.143130 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-9c8352ea-6646-4aa6-94c8-b4094c0de3b9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "POST /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783319 Aug 05 14:43:43.143740 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 562/1158] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Aug 5 14:43:42 2022] POST /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:43:51.814355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:51.814897 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:51.821448 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:51.821936 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:51.822375 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:51.823066 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:51.823525 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:51.823953 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:51.904451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'services' on Instance uuid 14f4287c-f5a4-4c87-b293-c6d173edf59e {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:43:52.104552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e0ffbd60-ea6d-4e6a-a320-62ba55fdc5cf tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments/92938a19-be49-4362-a462-b2ce0291d186" status: 202 len: 0 microversion: 2.1 time: 0.294920 Aug 05 14:43:52.105141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 597/1159] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Aug 5 14:43:51 2022] DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments/92938a19-be49-4362-a462-b2ce0291d186 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:43:52.116146 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:52.118555 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:52.125788 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:52.126269 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:52.126702 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:52.127438 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:52.127883 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:52.128303 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:52.158187 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-c20eb0af-6196-44e5-b289-92b26231a294 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047159 Aug 05 14:43:52.158818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 563/1160] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:43:52 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:43:53.171958 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:53.174355 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:53.180796 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:53.181281 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:53.181719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:53.182516 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:53.182974 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:53.183402 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:53.214348 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-b2cfbd0c-a393-48af-ad38-56b007bc1590 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047268 Aug 05 14:43:53.214931 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 598/1161] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Aug 5 14:43:53 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 14:43:53.276988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:53.277554 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:53.284647 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:53.285134 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:53.285569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:53.286316 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:53.286774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:53.287197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:53.314988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:43:53.630382 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-895b2cf4-d374-4d2d-bcb8-20ec3ccefed3 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 204 len: 0 microversion: 2.1 time: 0.357037 Aug 05 14:43:53.630973 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 564/1162] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:43:53 2022] DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:43:53.639022 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:53.640252 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:53.646076 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:53.646545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:53.646973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:53.647647 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:53.648091 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:53.648532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:53.777719 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:43:53.785136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-2e318a7a-4e85-46c1-a214-764e6212d314 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1681 microversion: 2.1 time: 0.149905 Aug 05 14:43:53.785698 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 599/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:43:53 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:43:54.806731 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:54.807335 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:54.813659 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:54.814133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:54.814587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:54.815265 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:54.815709 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:54.816127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:54.955852 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:43:54.963594 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6c6c2145-f449-49a3-a9c1-0d539b67c802 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1681 microversion: 2.1 time: 0.161178 Aug 05 14:43:54.964172 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 565/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:43:54 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:43:55.985771 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:55.986417 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:55.993051 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:55.993534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:55.993967 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:55.994659 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:55.995110 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:55.995557 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:56.126206 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:43:56.135321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9521bca3-d4ec-4519-84f3-837797d5c445 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1681 microversion: 2.1 time: 0.154173 Aug 05 14:43:56.135911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 600/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:43:55 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:43:56.664385 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-617df982-361c-414d-a9db-3cd74394fbcd req-a5194b84-4402-45a3-99e2-f8283f6de652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f4287c-f5a4-4c87-b293-c6d173edf59e", "name": "network-vif-deleted", "tag": "475a3ea1-c22d-4b23-a1f6-fb0f324c577b"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:43:56.674997 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-617df982-361c-414d-a9db-3cd74394fbcd req-a5194b84-4402-45a3-99e2-f8283f6de652 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:56.681033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-617df982-361c-414d-a9db-3cd74394fbcd req-a5194b84-4402-45a3-99e2-f8283f6de652 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:56.681033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-617df982-361c-414d-a9db-3cd74394fbcd req-a5194b84-4402-45a3-99e2-f8283f6de652 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:56.687032 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-617df982-361c-414d-a9db-3cd74394fbcd req-a5194b84-4402-45a3-99e2-f8283f6de652 service nova] Creating event network-vif-deleted:475a3ea1-c22d-4b23-a1f6-fb0f324c577b for instance 14f4287c-f5a4-4c87-b293-c6d173edf59e on hv-cinder-80295 Aug 05 14:43:56.692012 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-617df982-361c-414d-a9db-3cd74394fbcd req-a5194b84-4402-45a3-99e2-f8283f6de652 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 Aug 05 14:43:56.692637 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 566/1166] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:43:57.164929 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:57.165686 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:57.173059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:57.173539 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:57.173968 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:57.174652 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:57.175095 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:57.175514 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:57.206865 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:57.207344 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:57.207783 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:57.208227 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lazy-loading 'fault' on Instance uuid 14f4287c-f5a4-4c87-b293-c6d173edf59e {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:43:57.249658 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cb8261b328c4cd8956762971fefceee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc63bf4a15624098aa5568cad2c003ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:43:57.257321 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0e54001f-9282-4ead-b1bc-795e8b8f16d9 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 200 len: 1331 microversion: 2.1 time: 0.096382 Aug 05 14:43:57.257901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 601/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:43:57 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:43:58.279119 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:58.279733 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:43:58.286401 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:58.286875 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:58.287307 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:58.287988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:43:58.288460 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:43:58.288888 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:43:58.302368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e HTTP/1.1 Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:43:58.303960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:43:58.305859 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '14f4287c-f5a4-4c87-b293-c6d173edf59e'} Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:43:58.306757 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:43:58.308465 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:43:58.310044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:43:58.310044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-520908f3-3188-48a2-9282-67994bb6999e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 404 len: 111 microversion: 2.1 time: 0.031014 Aug 05 14:43:58.310044 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 567/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:43:58 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:43:58.314102 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-db171b42-b729-43e5-8e33-f01750a619ab tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '.version_select at 0x7fa75d4a1a60>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:43:58.396212 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-db171b42-b729-43e5-8e33-f01750a619ab tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428541335" status: 202 len: 0 microversion: 2.1 time: 0.085864 Aug 05 14:43:58.396837 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 602/1169] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Aug 5 14:43:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428541335 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:44:00.414354 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:00.414849 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:00.421279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:00.421756 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:00.422188 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:00.422865 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:00.423314 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:00.423741 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:00.439279 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e HTTP/1.1 Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:44:00.440835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.446334 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '14f4287c-f5a4-4c87-b293-c6d173edf59e'} Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:00.447299 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.448955 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.450567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:00.450567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-d72a0df4-34d1-4086-8c60-b8023b36834e tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 404 len: 111 microversion: 2.1 time: 0.031740 Aug 05 14:44:00.450567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 568/1170] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:44:00 2022] DELETE /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:44:00.451491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:00.452986 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 14f4287c-f5a4-4c87-b293-c6d173edf59e] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:00.459592 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:00.460078 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:00.460553 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:00.461279 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:00.461739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:00.462209 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:00.476575 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e HTTP/1.1 Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:44:00.478205 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.479964 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '14f4287c-f5a4-4c87-b293-c6d173edf59e'} Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:00.480859 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. Aug 05 14:44:00.482328 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:00.483761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance 14f4287c-f5a4-4c87-b293-c6d173edf59e could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:00.483761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-063a6c38-9d48-45fb-9554-a2d3ecf141c6 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e" status: 404 len: 111 microversion: 2.1 time: 0.032784 Aug 05 14:44:00.483761 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 603/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:00 2022] GET /compute/v2.1/servers/14f4287c-f5a4-4c87-b293-c6d173edf59e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:44:01.688783 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:01.689302 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:01.695272 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.695746 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.696180 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.696891 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.697343 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.697765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.710829 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f HTTP/1.1 Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:44:01.712338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.714337 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '258a17a5-dad7-4d81-b7c5-5a661bb9fd3f'} Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:01.715356 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.717083 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.719249 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:01.719249 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ae889389-f353-4bd6-8e08-b4da81a9b5f5 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 404 len: 111 microversion: 2.1 time: 0.029816 Aug 05 14:44:01.719249 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 569/1172] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:44:01 2022] DELETE /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:44:01.722599 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:01.723215 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:01.729572 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.730054 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.730491 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.731188 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.731644 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.732068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.745421 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f HTTP/1.1 Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:44:01.746901 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.748608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': '258a17a5-dad7-4d81-b7c5-5a661bb9fd3f'} Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:01.749633 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. Aug 05 14:44:01.751870 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.753440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance 258a17a5-dad7-4d81-b7c5-5a661bb9fd3f could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:01.753440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-de4f9b26-e85d-437a-9a35-3631c95f81a8 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f" status: 404 len: 111 microversion: 2.1 time: 0.029570 Aug 05 14:44:01.753440 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 604/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:01 2022] GET /compute/v2.1/servers/258a17a5-dad7-4d81-b7c5-5a661bb9fd3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:44:01.757365 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:01.757841 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:01.763708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.764184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.764661 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.765349 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.765798 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.766219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.779209 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 HTTP/1.1 Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:44:01.780919 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.782681 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'c91bec62-a7dd-401a-8017-b9a97847c352'} Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:01.783693 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.785340 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.787219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:01.787219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ba03f59b-162b-47d1-bf1b-fa5da2840546 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 404 len: 111 microversion: 2.1 time: 0.028717 Aug 05 14:44:01.787219 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 570/1174] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:44:01 2022] DELETE /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:44:01.790450 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:01.791060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: c91bec62-a7dd-401a-8017-b9a97847c352] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:01.797413 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.797894 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.798329 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.799015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:01.799463 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:01.799885 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:01.815391 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 HTTP/1.1 Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:44:01.816910 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.818651 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'c91bec62-a7dd-401a-8017-b9a97847c352'} Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:01.819602 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. Aug 05 14:44:01.821250 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:01.822681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance c91bec62-a7dd-401a-8017-b9a97847c352 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:01.822681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-1b75c1e5-808b-49c0-a5ac-a535d91dedef tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352" status: 404 len: 111 microversion: 2.1 time: 0.031594 Aug 05 14:44:01.822681 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 605/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:01 2022] GET /compute/v2.1/servers/c91bec62-a7dd-401a-8017-b9a97847c352 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 14:44:03.112118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:03.112635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:03.118963 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:03.119448 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:03.119879 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:03.120597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:03.121071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:03.121477 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:03.135019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 HTTP/1.1 Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:44:03.136569 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.138414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'ca7c9c9f-0250-411b-8fdb-cbd85886ffc8'} Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:03.139567 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.141245 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.142816 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:03.142816 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-ae121ea9-0e0f-4894-a760-f0c3a9ffe0ac tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 404 len: 111 microversion: 2.1 time: 0.030115 Aug 05 14:44:03.142816 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 571/1176] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:44:03 2022] DELETE /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:44:03.147174 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:03.147810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] [instance: ca7c9c9f-0250-411b-8fdb-cbd85886ffc8] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:03.154287 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:03.154812 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:03.155220 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:03.155969 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:03.156555 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:03.156977 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:03.170213 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] HTTP exception thrown: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Request method failure captured: Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 HTTP/1.1 Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Sq6d-h1V81v_9HV2obj1ZVDVCp-O1OatkqBM_IgzpKo1cz8JAF87R2SEZA98brhw1mX_t11wyTO-TRwPv0kBz3tRGp9tZJmvwr9n_NYeiTbJYWyye0QrcSMRuht8iZd0_RTmqlIirn_4qS9plETxpxQhyke6T06hS8xfAhJo5A7WJQ Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:44:03.172549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc63bf4a15624098aa5568cad2c003ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc63bf4a15624098aa5568cad2c003ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: bc63bf4a15624098aa5568cad2c003ae Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447687705 Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: 0cb8261b328c4cd8956762971fefceee Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-AttachVolumeNegativeTest-1447687705-project Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.174292 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'ca7c9c9f-0250-411b-8fdb-cbd85886ffc8'} Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:44:03.175264 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. Aug 05 14:44:03.176908 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:44:03.178416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] Returning 404 to user: Instance ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:44:03.178416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-f19fc6fc-11cb-4b38-882a-610327150f24 tempest-AttachVolumeNegativeTest-1447687705 tempest-AttachVolumeNegativeTest-1447687705-project] 10.222.0.26 "GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8" status: 404 len: 111 microversion: 2.1 time: 0.030626 Aug 05 14:44:03.178416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 606/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:03 2022] GET /compute/v2.1/servers/ca7c9c9f-0250-411b-8fdb-cbd85886ffc8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:44:34.622463 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1807009711", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-402318749", "security_groups": [{"name": "tempest-secgroup-smoke-966977818"}], "block_device_mapping_v2": [{"uuid": "55396ffc-2935-4da1-9a67-acaa25f3df9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "190f2fff-2ff1-45fd-bd0d-e0bb27a89b96"}]}} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:44:34.632796 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:34.633487 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:34.743765 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.network.neutron [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] validate_networks() for [('190f2fff-2ff1-45fd-bd0d-e0bb27a89b96', None, None, None, None, None)] {{(pid=118052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 14:44:35.211175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Flavor limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 14:44:35.211602 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Image limits 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 14:44:35.214215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Flavor pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 14:44:35.214215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Image pref 0:0:0 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 14:44:35.214215 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.virt.hardware [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 14:44:35.222523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:35.223007 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:35.223444 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:35.224175 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:35.224663 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:35.225093 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:35.242182 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for project d408cabccaa44c338d6031955d3a1f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 14:44:35.246157 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.quota [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Getting quotas for user f7b9ccd1b8cc4832a9c77513b5f21815 and project d408cabccaa44c338d6031955d3a1f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=118052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 14:44:35.303459 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Going to run 1 instances... {{(pid=118052) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 14:44:35.305572 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55396ffc-2935-4da1-9a67-acaa25f3df9b',volume_size=None,volume_type=None)] {{(pid=118052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 14:44:35.715725 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [29dbd354-6fe0-41f7-96f1-1e42b3490187] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 14:44:36.724076 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [29dbd354-6fe0-41f7-96f1-1e42b3490187] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47610. Aug 05 14:44:36.728324 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2de8f17a-40d7-43bb-a249-20a40fda2b17 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.109834 Aug 05 14:44:36.729035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 572/1178] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Aug 5 14:44:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 14:44:36.741150 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-bee1adcf-adca-492e-9a15-a23088b410ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:36.741903 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-bee1adcf-adca-492e-9a15-a23088b410ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:36.745115 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:36.745787 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:36.803196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-bee1adcf-adca-492e-9a15-a23088b410ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:36.810015 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-bee1adcf-adca-492e-9a15-a23088b410ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1094 microversion: 2.1 time: 0.073942 Aug 05 14:44:36.810580 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 607/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:36 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:37.832184 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:37.833271 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:37.839311 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:37.839811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:37.840236 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:37.840960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:37.841414 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:37.841836 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:37.905258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:37.914878 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-18121c80-deff-4f71-ad82-53d8f1a08ca6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1144 microversion: 2.1 time: 0.087465 Aug 05 14:44:37.915576 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 573/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:37 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:38.935196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:38.936376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:38.944802 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:38.945342 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:38.945678 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:38.946370 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:38.946867 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:38.947293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:39.021068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:39.029749 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-4a7fbd9a-de79-49c3-9bf8-08b606c24f53 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1192 microversion: 2.1 time: 0.098475 Aug 05 14:44:39.030549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 608/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:38 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:40.055878 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:40.056519 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:40.062576 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:40.063364 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:40.064035 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:40.064940 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:40.066623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:40.067240 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:40.226259 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:40.234293 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-3fa352ef-ef2e-4263-9ef7-ec485d0d2f54 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1277 microversion: 2.1 time: 0.184068 Aug 05 14:44:40.240510 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 574/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:40 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:40.768273 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-7eea9826-a1e1-4c0c-9a6e-54e4609fc484 req-a9f8bef3-d145-4437-b75b-dd6c3bc0542f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37e9b84-d20d-48dc-a334-4e35d8ff32ce", "tag": "bbbd6103-135a-4893-ab2b-bba66c5ce4cf"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:44:40.783038 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-7eea9826-a1e1-4c0c-9a6e-54e4609fc484 req-a9f8bef3-d145-4437-b75b-dd6c3bc0542f service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:40.783515 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-7eea9826-a1e1-4c0c-9a6e-54e4609fc484 req-a9f8bef3-d145-4437-b75b-dd6c3bc0542f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:40.783954 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-7eea9826-a1e1-4c0c-9a6e-54e4609fc484 req-a9f8bef3-d145-4437-b75b-dd6c3bc0542f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:40.795743 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-7eea9826-a1e1-4c0c-9a6e-54e4609fc484 req-a9f8bef3-d145-4437-b75b-dd6c3bc0542f service nova] Creating event network-changed:bbbd6103-135a-4893-ab2b-bba66c5ce4cf for instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce on hv-cinder-80295 Aug 05 14:44:40.800923 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-7eea9826-a1e1-4c0c-9a6e-54e4609fc484 req-a9f8bef3-d145-4437-b75b-dd6c3bc0542f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037935 Aug 05 14:44:40.801710 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 609/1183] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:44:41.256151 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:41.256811 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:41.263199 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:41.263687 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:41.264127 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:41.264909 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:41.265375 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:41.265898 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:41.406386 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:41.414314 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-0709ba44-a518-4ac5-89ce-b4dff49a3e3d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.163098 Aug 05 14:44:41.414915 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 575/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:41 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:42.439196 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:42.439911 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:42.447505 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:42.447995 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:42.448452 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:42.449157 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:42.449608 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:42.450032 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:42.592537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:42.600966 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-228663c7-165f-4777-9154-d8ef222d7122 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.168022 Aug 05 14:44:42.601547 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 610/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:42 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:43.626118 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:43.627005 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:43.634290 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:43.634775 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:43.635204 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:43.635899 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:43.636346 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:43.637125 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:43.774276 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:43.781886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-74ac5c56-0f10-4678-86fc-971ed351dfe1 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.162274 Aug 05 14:44:43.782388 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 576/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:43 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:44.802646 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:44.803198 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:44.809752 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:44.810239 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:44.810696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:44.811384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:44.811838 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:44.812262 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:44.950203 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:44.960249 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-178c960f-f04d-453b-a3b6-452c4d6c8454 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.161589 Aug 05 14:44:44.960927 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 611/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:44 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:45.981697 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:45.982306 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:45.984712 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=2 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:45.985391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell0:SELECT=6 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:45.990594 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:45.996295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:45.996295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:45.996295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:45.996295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:45.996807 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:46.128194 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:46.135944 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4606a625-452a-4269-8dbc-60b6b493e156 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.158139 Aug 05 14:44:46.136541 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 577/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:45 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:47.157818 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:47.158426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:47.160490 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell0:SELECT=2 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:44:47.165441 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:47.165906 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:47.166424 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:47.167114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:47.167758 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:47.168548 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:47.300703 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:47.308707 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-11abb9cf-e770-4900-aa8f-739341a9a203 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.154867 Aug 05 14:44:47.309271 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 612/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:47 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:48.330389 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:48.330943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:48.337817 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:48.338291 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:48.338719 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:48.339411 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:48.339855 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:48.340268 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:48.477350 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:48.484695 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-7ece2d95-2181-475c-94a7-d1ac9c45e80c tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.158296 Aug 05 14:44:48.485258 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 578/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:48 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:49.504950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:49.506479 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:49.512912 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:49.513388 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:49.513824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:49.514511 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:49.514962 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:49.515383 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:49.650296 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:49.657701 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-42d9030d-da54-42eb-ae1b-9a75c33cc218 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.156620 Aug 05 14:44:49.658303 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 613/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:49 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:44:50.678460 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:50.679071 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:50.685595 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:50.686070 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:50.686503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:50.687186 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:50.687635 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:50.688053 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:50.820366 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:50.828088 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-b1e44026-4f6e-4621-816c-c621e9f37187 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.153738 Aug 05 14:44:50.828686 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 579/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:50 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:51.851102 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:51.851716 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:51.858221 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:51.858696 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:51.859125 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:51.859810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:51.860293 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:51.860744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:51.989567 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:51.997002 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-739ef8b8-3f2e-4ae7-b4e8-f678877481d4 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.150913 Aug 05 14:44:51.997569 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 614/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:51 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:53.017601 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:53.018212 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:53.024675 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:53.025162 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:53.025599 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:53.026284 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:53.026767 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:53.027191 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:53.171623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:53.171623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-334d33b5-ba6b-4dbd-9c1e-b214fa07d110 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.152850 Aug 05 14:44:53.171623 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 580/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:53 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:53.854827 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-2221e9c2-38d7-4930-b2d4-db1ba8a04d8e req-e3a3f776-78f1-413c-8a57-49497595d3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37e9b84-d20d-48dc-a334-4e35d8ff32ce", "name": "network-vif-plugged", "status": "completed", "tag": "bbbd6103-135a-4893-ab2b-bba66c5ce4cf"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:44:53.863999 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2221e9c2-38d7-4930-b2d4-db1ba8a04d8e req-e3a3f776-78f1-413c-8a57-49497595d3eb service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:53.864552 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2221e9c2-38d7-4930-b2d4-db1ba8a04d8e req-e3a3f776-78f1-413c-8a57-49497595d3eb service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:53.866116 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2221e9c2-38d7-4930-b2d4-db1ba8a04d8e req-e3a3f776-78f1-413c-8a57-49497595d3eb service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:53.875764 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-2221e9c2-38d7-4930-b2d4-db1ba8a04d8e req-e3a3f776-78f1-413c-8a57-49497595d3eb service nova] Creating event network-vif-plugged:bbbd6103-135a-4893-ab2b-bba66c5ce4cf for instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce on hv-cinder-80295 Aug 05 14:44:53.881364 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-2221e9c2-38d7-4930-b2d4-db1ba8a04d8e req-e3a3f776-78f1-413c-8a57-49497595d3eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180519 Aug 05 14:44:53.881960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 615/1195] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:44:54.187274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:54.187942 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:54.194951 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:54.195429 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:54.195869 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:54.196650 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:54.197108 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:54.197530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:54.331624 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:54.339972 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-bc6fa24f-cf25-464b-a06c-d4a428942835 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.156737 Aug 05 14:44:54.340565 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 581/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:54 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:55.362325 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:55.363060 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:55.369824 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:55.370305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:55.370940 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:55.371427 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:55.371880 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:55.372307 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:55.502248 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:55.510064 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-d4eb8e62-dcf0-4d85-a58f-c9d0ceb72c90 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.152476 Aug 05 14:44:55.510984 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 616/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:55 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:56.531372 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:56.532013 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:56.539133 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:56.539609 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:56.540042 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:56.540750 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:56.541201 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:56.541620 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:56.677033 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:56.684542 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-6b6e2945-2d69-4975-a932-955a419a4aa6 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1265 microversion: 2.1 time: 0.157065 Aug 05 14:44:56.685107 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 582/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:56 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:57.704807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:57.705426 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:57.712933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:57.713416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:57.713854 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:57.714549 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:57.715005 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:57.715433 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:57.844803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:57.852956 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-3ebcad12-dde3-427d-9d4d-e1de57b27a78 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1453 microversion: 2.1 time: 0.151969 Aug 05 14:44:57.853532 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 617/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:57 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:44:57.873332 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:44:57.873943 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:44:57.880368 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:57.880886 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:57.881324 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:57.882014 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:44:57.882470 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:44:57.882894 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:44:58.014523 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:44:58.022723 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-5829f6d0-4b8b-4259-babe-5eab9a5710a7 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1453 microversion: 2.1 time: 0.153214 Aug 05 14:44:58.023297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 583/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:44:57 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:45:00.366068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-602efb9d-2acc-4709-976f-b1c568f88a40 req-de0a974d-5ad7-4931-ab68-fbf5814cccd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37e9b84-d20d-48dc-a334-4e35d8ff32ce", "tag": "bbbd6103-135a-4893-ab2b-bba66c5ce4cf"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:45:00.375830 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-602efb9d-2acc-4709-976f-b1c568f88a40 req-de0a974d-5ad7-4931-ab68-fbf5814cccd8 service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:45:00.376305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-602efb9d-2acc-4709-976f-b1c568f88a40 req-de0a974d-5ad7-4931-ab68-fbf5814cccd8 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:45:00.376773 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-602efb9d-2acc-4709-976f-b1c568f88a40 req-de0a974d-5ad7-4931-ab68-fbf5814cccd8 service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:45:00.387591 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-602efb9d-2acc-4709-976f-b1c568f88a40 req-de0a974d-5ad7-4931-ab68-fbf5814cccd8 service nova] Creating event network-changed:bbbd6103-135a-4893-ab2b-bba66c5ce4cf for instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce on hv-cinder-80295 Aug 05 14:45:00.392660 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-602efb9d-2acc-4709-976f-b1c568f88a40 req-de0a974d-5ad7-4931-ab68-fbf5814cccd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030922 Aug 05 14:45:00.393269 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 618/1201] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:45:12.003837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:45:12.004406 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Fri Aug 5 14:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:45:38.433023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:45:38.433523 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:45:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:47:06.822726 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:47:06.823446 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:47:15.432441 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:47:15.433442 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG dbcounter [-] [118052] Writing DB stats nova_cell1:SELECT=68 {{(pid=118052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:47:15.435165 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR oslo.messaging._drivers.impl_rabbit [-] [526be8e6-007e-4d1e-af4e-d1126b765772] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 05 14:47:15.435798 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_api:SELECT=26 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:47:15.436730 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG dbcounter [-] [118053] Writing DB stats nova_cell1:SELECT=54 {{(pid=118053) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 14:47:15.439045 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:15.439639 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:15.441075 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-2652857d-bd77-451a-b7cf-26353f9dd169 req-fd1e1b82-10b5-42e2-9788-02e6efdc273a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37e9b84-d20d-48dc-a334-4e35d8ff32ce", "tag": "bbbd6103-135a-4893-ab2b-bba66c5ce4cf"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:47:15.447155 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:15.451930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:15.451930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:15.451930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:15.451930 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:15.452455 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:15.452545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2652857d-bd77-451a-b7cf-26353f9dd169 req-fd1e1b82-10b5-42e2-9788-02e6efdc273a service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:15.452545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2652857d-bd77-451a-b7cf-26353f9dd169 req-fd1e1b82-10b5-42e2-9788-02e6efdc273a service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:15.452545 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-2652857d-bd77-451a-b7cf-26353f9dd169 req-fd1e1b82-10b5-42e2-9788-02e6efdc273a service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:15.463934 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-2652857d-bd77-451a-b7cf-26353f9dd169 req-fd1e1b82-10b5-42e2-9788-02e6efdc273a service nova] Creating event network-changed:bbbd6103-135a-4893-ab2b-bba66c5ce4cf for instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce on hv-cinder-80295 Aug 05 14:47:15.469626 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-2652857d-bd77-451a-b7cf-26353f9dd169 req-fd1e1b82-10b5-42e2-9788-02e6efdc273a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 Aug 05 14:47:15.470234 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 619/1202] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:47:15.484294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Going to try to terminate instance {{(pid=118052) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:47:15.702616 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [6930236b-4644-4773-94ca-b093bd6f6e0a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 14:47:16.711430 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [6930236b-4644-4773-94ca-b093bd6f6e0a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47952. Aug 05 14:47:16.784503 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-2a7e640f-439b-4f11-8319-4461b40841ed tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 204 len: 0 microversion: 2.1 time: 1.353695 Aug 05 14:47:16.785019 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 584/1203] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:47:15 2022] DELETE /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 0 bytes in 1355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:47:16.796753 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:16.797451 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:16.806458 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:16.806942 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:16.807376 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:16.808059 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:16.808534 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:16.808955 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:16.812714 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] [526be8e6-007e-4d1e-af4e-d1126b765772] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47956. Aug 05 14:47:17.059866 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:17.067481 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-7c9d4f83-dcc8-46da-b2f5-e569e885a84a tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1459 microversion: 2.1 time: 0.277315 Aug 05 14:47:17.068162 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 620/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:16 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1459 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:47:18.091539 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:18.092234 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:18.099361 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:18.099835 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:18.100295 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:18.101006 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:18.101447 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:18.101868 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:18.279988 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:18.288960 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-4ac8ee06-801e-4c23-92d3-368f0c4fa2ff tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1459 microversion: 2.1 time: 0.201699 Aug 05 14:47:18.289538 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 585/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:18 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1459 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 14:47:19.293468 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [req-fb436945-7579-4d69-a808-f597590c7e95 req-ebb206a4-f582-4f74-a584-9695053d9b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37e9b84-d20d-48dc-a334-4e35d8ff32ce", "name": "network-vif-deleted", "tag": "bbbd6103-135a-4893-ab2b-bba66c5ce4cf"}]} {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:47:19.304957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-fb436945-7579-4d69-a808-f597590c7e95 req-ebb206a4-f582-4f74-a584-9695053d9b0f service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:19.304957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-fb436945-7579-4d69-a808-f597590c7e95 req-ebb206a4-f582-4f74-a584-9695053d9b0f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:19.304957 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [req-fb436945-7579-4d69-a808-f597590c7e95 req-ebb206a4-f582-4f74-a584-9695053d9b0f service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:19.310297 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:19.314782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:19.316337 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.compute.server_external_events [req-fb436945-7579-4d69-a808-f597590c7e95 req-ebb206a4-f582-4f74-a584-9695053d9b0f service nova] Creating event network-vif-deleted:bbbd6103-135a-4893-ab2b-bba66c5ce4cf for instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce on hv-cinder-80295 Aug 05 14:47:19.317737 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:19.318226 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:19.318662 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:19.319966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:19.320673 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:19.321110 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:19.322558 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [req-fb436945-7579-4d69-a808-f597590c7e95 req-ebb206a4-f582-4f74-a584-9695053d9b0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092317 Aug 05 14:47:19.323305 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 621/1206] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:47:19.384031 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:19.391694 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-dfc35b73-fda1-4554-9b6b-6fb120cb2b2e tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1392 microversion: 2.1 time: 0.085343 Aug 05 14:47:19.392197 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 586/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:19 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1392 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:47:20.414114 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:20.414809 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:20.421135 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:20.421614 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:20.422048 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:20.422735 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:20.423186 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:20.423609 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:20.456670 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:20.457068 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:20.457506 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:20.457950 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lazy-loading 'fault' on Instance uuid e37e9b84-d20d-48dc-a334-4e35d8ff32ce {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:47:20.499515 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:20.507350 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-50856595-fb32-4dd3-9623-6ada512e9c88 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 200 len: 1230 microversion: 2.1 time: 0.098347 Aug 05 14:47:20.507933 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 622/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:20 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:47:21.528966 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:21.529600 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: e37e9b84-d20d-48dc-a334-4e35d8ff32ce] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:21.536124 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:21.536638 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:21.537176 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:21.539101 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:21.539597 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:21.540021 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:21.552974 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] HTTP exception thrown: Instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce could not be found. Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Request method failure captured: Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce HTTP/1.1 Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Stx1BCqsM27a_Enho3V87uywpYqRcKGkJMNU8mRMcCzLqcAvINjdTRu5ujApmMQbxapVjQXhL7uTVcN3karD69R9_vd4Z08Zo7id7YmP3FC9-mhLhftsEomFrLUOWyL9fbZ7xtY6rW7747ULyPjV-Okfu8es_OrFqTr2Ld0ivCcYoE Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:47:21.554970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d408cabccaa44c338d6031955d3a1f7c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: f7b9ccd1b8cc4832a9c77513b5f21815 Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce could not be found. Aug 05 14:47:21.556885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'e37e9b84-d20d-48dc-a334-4e35d8ff32ce'} Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce could not be found. Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:47:21.557921 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce could not be found. Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce could not be found. Aug 05 14:47:21.559732 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:21.561378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Returning 404 to user: Instance e37e9b84-d20d-48dc-a334-4e35d8ff32ce could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:47:21.561378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-278d0e5e-952c-4799-b48e-0ef0e8966578 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce" status: 404 len: 111 microversion: 2.1 time: 0.031307 Aug 05 14:47:21.561378 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 587/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:21 2022] GET /compute/v2.1/servers/e37e9b84-d20d-48dc-a334-4e35d8ff32ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:47:24.931981 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:24.932631 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:24.941014 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:24.941766 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:24.942301 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:24.943087 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:24.943744 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:24.944365 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:24.972803 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Going to try to terminate instance {{(pid=118053) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 14:47:24.995144 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-f338e59f-c156-4375-af5d-0d14f39b45c2 req-6f44867d-fe9d-4baf-8402-a8385ede62ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fe0551-af11-4c71-965b-dfb1a1068d9a", "tag": "32492fe9-d310-4716-a3db-25a2b51dcc8f"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:47:25.005255 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f338e59f-c156-4375-af5d-0d14f39b45c2 req-6f44867d-fe9d-4baf-8402-a8385ede62ed service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:25.005806 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f338e59f-c156-4375-af5d-0d14f39b45c2 req-6f44867d-fe9d-4baf-8402-a8385ede62ed service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:25.006774 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-f338e59f-c156-4375-af5d-0d14f39b45c2 req-6f44867d-fe9d-4baf-8402-a8385ede62ed service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:25.019094 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-f338e59f-c156-4375-af5d-0d14f39b45c2 req-6f44867d-fe9d-4baf-8402-a8385ede62ed service nova] Creating event network-changed:32492fe9-d310-4716-a3db-25a2b51dcc8f for instance 06fe0551-af11-4c71-965b-dfb1a1068d9a on hv-cinder-80295 Aug 05 14:47:25.024768 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-f338e59f-c156-4375-af5d-0d14f39b45c2 req-6f44867d-fe9d-4baf-8402-a8385ede62ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094623 Aug 05 14:47:25.025439 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 588/1210] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 14:47:25.207694 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-8acbca58-6e6a-4ad4-97ac-e88c8529614f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 204 len: 0 microversion: 2.1 time: 0.280518 Aug 05 14:47:25.219416 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 623/1211] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:47:24 2022] DELETE /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 14:47:25.221057 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:25.221837 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:25.229181 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:25.229782 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:25.230274 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:25.231221 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:25.231747 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:25.232235 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:25.387352 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.policy [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:25.395467 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-aa007829-ba81-47c8-a93d-8168328dd901 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1576 microversion: 2.1 time: 0.179256 Aug 05 14:47:25.396283 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 589/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:25 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:47:26.418526 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:26.419268 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:26.425780 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:26.426257 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:26.426690 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:26.427380 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:26.427832 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:26.428807 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:26.559606 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:26.567336 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-e5d4077a-6c00-44c6-9f7d-e44c500f5b1f tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1458 microversion: 2.1 time: 0.153144 Aug 05 14:47:26.567905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 624/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:26 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1458 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:47:26.675720 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [req-5c8e8f5c-cd41-43b3-87dd-9022bcd1f0f0 req-6fafbb58-2a85-4bd5-b3ef-575175374ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fe0551-af11-4c71-965b-dfb1a1068d9a", "name": "network-vif-deleted", "tag": "32492fe9-d310-4716-a3db-25a2b51dcc8f"}]} {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 14:47:26.685636 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-5c8e8f5c-cd41-43b3-87dd-9022bcd1f0f0 req-6fafbb58-2a85-4bd5-b3ef-575175374ddb service nova] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:26.686106 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-5c8e8f5c-cd41-43b3-87dd-9022bcd1f0f0 req-6fafbb58-2a85-4bd5-b3ef-575175374ddb service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:26.686525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [req-5c8e8f5c-cd41-43b3-87dd-9022bcd1f0f0 req-6fafbb58-2a85-4bd5-b3ef-575175374ddb service nova] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:26.697387 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.compute.server_external_events [req-5c8e8f5c-cd41-43b3-87dd-9022bcd1f0f0 req-6fafbb58-2a85-4bd5-b3ef-575175374ddb service nova] Creating event network-vif-deleted:32492fe9-d310-4716-a3db-25a2b51dcc8f for instance 06fe0551-af11-4c71-965b-dfb1a1068d9a on hv-cinder-80295 Aug 05 14:47:26.702247 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [req-5c8e8f5c-cd41-43b3-87dd-9022bcd1f0f0 req-6fafbb58-2a85-4bd5-b3ef-575175374ddb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030138 Aug 05 14:47:26.702818 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 590/1214] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Aug 5 14:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 14:47:27.592094 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:27.593170 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:27.602438 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:27.602937 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:27.603368 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:27.604053 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:27.604537 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:27.604960 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:27.635830 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:27.636308 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:27.636791 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:27.637229 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.objects.instance [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lazy-loading 'fault' on Instance uuid 06fe0551-af11-4c71-965b-dfb1a1068d9a {{(pid=118053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 14:47:27.677414 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.policy [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b9ccd1b8cc4832a9c77513b5f21815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd408cabccaa44c338d6031955d3a1f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118053) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 14:47:27.685166 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-0151cc3b-32a1-45c8-8384-ed50ba7ac010 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 200 len: 1230 microversion: 2.1 time: 0.100440 Aug 05 14:47:27.685739 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 625/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:27 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 14:47:28.707525 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:28.713063 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: 06fe0551-af11-4c71-965b-dfb1a1068d9a] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:28.715294 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:28.715772 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:28.716205 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:28.716918 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:28.717371 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:28.717788 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:28.731513 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] HTTP exception thrown: Instance 06fe0551-af11-4c71-965b-dfb1a1068d9a could not be found. Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Request method failure captured: Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a HTTP/1.1 Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Stx1BCqsM27a_Enho3V87uywpYqRcKGkJMNU8mRMcCzLqcAvINjdTRu5ujApmMQbxapVjQXhL7uTVcN3karD69R9_vd4Z08Zo7id7YmP3FC9-mhLhftsEomFrLUOWyL9fbZ7xtY6rW7747ULyPjV-Okfu8es_OrFqTr2Ld0ivCcYoE Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:47:28.733156 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d408cabccaa44c338d6031955d3a1f7c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: f7b9ccd1b8cc4832a9c77513b5f21815 Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance 06fe0551-af11-4c71-965b-dfb1a1068d9a could not be found. Aug 05 14:47:28.734847 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': '06fe0551-af11-4c71-965b-dfb1a1068d9a'} Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fe0551-af11-4c71-965b-dfb1a1068d9a could not be found. Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:47:28.735813 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fe0551-af11-4c71-965b-dfb1a1068d9a could not be found. Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fe0551-af11-4c71-965b-dfb1a1068d9a could not be found. Aug 05 14:47:28.743141 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:28.744622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Returning 404 to user: Instance 06fe0551-af11-4c71-965b-dfb1a1068d9a could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:47:28.744622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-05321521-81b8-4b11-b443-dba4a05ae476 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a" status: 404 len: 111 microversion: 2.1 time: 0.031771 Aug 05 14:47:28.744622 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 591/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:28 2022] GET /compute/v2.1/servers/06fe0551-af11-4c71-965b-dfb1a1068d9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:47:29.250616 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:29.251141 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.compute.api [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118053) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:29.257748 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:29.258233 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:29.258664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:29.259356 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:29.259810 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:29.260237 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG oslo_concurrency.lockutils [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:29.273510 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.wsgi [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] HTTP exception thrown: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Request method failure captured: Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: request: DELETE /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c HTTP/1.1 Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept: application/json Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Accept-Encoding: identity Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Connection: close Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Length: 0 Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Content-Type: application/json Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Host: 10.222.0.26 Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Openstack-System-Scope: None Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: User-Agent: python-urllib3/1.26.11 Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Auth-Token: gAAAAABi7Stx1BCqsM27a_Enho3V87uywpYqRcKGkJMNU8mRMcCzLqcAvINjdTRu5ujApmMQbxapVjQXhL7uTVcN3karD69R9_vd4Z08Zo7id7YmP3FC9-mhLhftsEomFrLUOWyL9fbZ7xtY6rW7747ULyPjV-Okfu8es_OrFqTr2Ld0ivCcYoE Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Id: None Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Domain-Name: None Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Identity-Status: Confirmed Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Is-Admin-Project: True Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Id: default Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Domain-Name: Default Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Project-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Role: member,reader Aug 05 14:47:29.275136 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Roles: member,reader Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d408cabccaa44c338d6031955d3a1f7c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-Tenant-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Id: default Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Domain-Name: Default Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Id: f7b9ccd1b8cc4832a9c77513b5f21815 Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: X-User-Name: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: method: > Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: exception: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.276913 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: action_args: {'id': 'a699c20b-23fc-40e9-ac3d-d835d5b7397c'} Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:47:29.277965 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.279604 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.281384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Returning 404 to user: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. {{(pid=118053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:47:29.281384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-501a9416-30fb-4124-bc3e-e72648eec657 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 404 len: 111 microversion: 2.1 time: 0.029866 Aug 05 14:47:29.281384 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 626/1217] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Aug 5 14:47:29 2022] DELETE /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:47:29.284977 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '>' {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:29.285587 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.compute.api [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] [instance: a699c20b-23fc-40e9-ac3d-d835d5b7397c] Fetching instance by UUID {{(pid=118052) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 14:47:29.292473 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:29.292956 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:29.293391 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:29.294079 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Acquiring lock "282df96a-f269-4d6d-8196-fcd51de3f20c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 14:47:29.294530 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 14:47:29.294949 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG oslo_concurrency.lockutils [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Lock "282df96a-f269-4d6d-8196-fcd51de3f20c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 14:47:29.308708 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.wsgi [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] HTTP exception thrown: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Request method failure captured: Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: request: GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c HTTP/1.1 Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept: application/json Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Accept-Encoding: identity Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Connection: close Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Length: 0 Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Content-Type: application/json Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Host: 10.222.0.26 Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Openstack-System-Scope: None Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: User-Agent: python-urllib3/1.26.11 Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Auth-Token: gAAAAABi7Stx1BCqsM27a_Enho3V87uywpYqRcKGkJMNU8mRMcCzLqcAvINjdTRu5ujApmMQbxapVjQXhL7uTVcN3karD69R9_vd4Z08Zo7id7YmP3FC9-mhLhftsEomFrLUOWyL9fbZ7xtY6rW7747ULyPjV-Okfu8es_OrFqTr2Ld0ivCcYoE Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Id: None Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Domain-Name: None Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Identity-Status: Confirmed Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Is-Admin-Project: True Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Id: default Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Domain-Name: Default Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Project-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Role: member,reader Aug 05 14:47:29.310202 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Roles: member,reader Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d408cabccaa44c338d6031955d3a1f7c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d408cabccaa44c338d6031955d3a1f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Id: d408cabccaa44c338d6031955d3a1f7c Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-Tenant-Name: tempest-TestVolumeBootPattern-1620282533 Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Id: default Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Domain-Name: Default Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Id: f7b9ccd1b8cc4832a9c77513b5f21815 Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: X-User-Name: tempest-TestVolumeBootPattern-1620282533-project Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: method: > Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: exception: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.312011 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: action_args: {'id': 'a699c20b-23fc-40e9-ac3d-d835d5b7397c'} Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: {{(pid=118052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 14:47:29.313251 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. Aug 05 14:47:29.314861 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: ERROR nova.api.openstack.wsgi Aug 05 14:47:29.316619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: DEBUG nova.api.openstack.wsgi [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Returning 404 to user: Instance a699c20b-23fc-40e9-ac3d-d835d5b7397c could not be found. {{(pid=118052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 14:47:29.316619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO nova.api.openstack.requestlog [None req-a7472f16-ee6e-409f-9594-60b957c48535 tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c" status: 404 len: 111 microversion: 2.1 time: 0.030381 Aug 05 14:47:29.316619 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: [pid: 118052|app: 0|req: 592/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Aug 5 14:47:29 2022] GET /compute/v2.1/servers/a699c20b-23fc-40e9-ac3d-d835d5b7397c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 14:47:30.777664 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: DEBUG nova.api.openstack.wsgi [None req-9dc1c2a2-95d6-408b-8a2d-bee58b57da7d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] Calling method '.version_select at 0x7fa75d4601f0>' {{(pid=118053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 14:47:30.882905 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO nova.api.openstack.requestlog [None req-9dc1c2a2-95d6-408b-8a2d-bee58b57da7d tempest-TestVolumeBootPattern-1620282533 tempest-TestVolumeBootPattern-1620282533-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-402318749" status: 202 len: 0 microversion: 2.1 time: 0.109005 Aug 05 14:47:30.883521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: [pid: 118053|app: 0|req: 627/1219] 10.222.0.26 () {58 vars in 1260 bytes} [Fri Aug 5 14:47:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-402318749 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 14:48:32.012970 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:48:32.013575 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Fri Aug 5 14:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:48:58.442559 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:48:58.443185 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:48:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:50:18.898748 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:50:18.899399 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Fri Aug 5 14:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:50:26.830973 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:50:26.831521 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:50:36.721338 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:50:36.721885 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Fri Aug 5 14:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:51:52.021040 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:51:52.021792 dv-cinder-802955-8-iscsi devstack@n-api.service[118052]: Fri Aug 5 14:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:52:18.450423 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:52:18.451019 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 14:52:27.098211 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 14:52:27.099023 dv-cinder-802955-8-iscsi devstack@n-api.service[118053]: Fri Aug 5 14:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!